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Abstract: In this paper we investigate Nash equilibrium payoffs for two-player nonzero-sum 
stochastic differential games whose cost functionals are defined by a system of coupled backward 
stochastic differential equations. We obtain an existence theorem and a characterization theorem 
for Nash equilibrium payoffs. For this end the problem is described equivalently by a stochastic 
differential game with jumps. But, however, unlike the work by Buckdahn, Hu and Li [9], here 
the important tool of a dynamic programming principle for stopping times has to be developed. 
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Moreover, we prove that the lower and upper value functions are the viscosity solutions of the 
associated coupled systems of PDEs of Isaacs type, respectively. Our results generalize those by 
Buckdahn, Cardaliaguet and Rainer [7] and by Lin [16]. 

Keywords: stochastic differential game; Nash equilibrium payoff; backward stochastic dif- 
ferential equation; dynamic programming principle; dynamic programming principle for stopping 
1> ' times; coupled systems of Isaacs equations. 
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The objective of this paper is to study Nash equilibrium payoffs for two-player nonzero-sum 
stochastic differential games (SDGs, for short) with jumps and coupled nonlinear cost function- 
als. Since the pioneering work of Fleming and Souganidis [11], SDGs have been studied by many 
authors. For instance, recently, Buckdahn and Li [10] investigated zero-sum two-player SDGs 
with nonlinear cost functionals using a backward stochastic differential equation (BSDE, for 
$_i ■ short) approach. Unlike Fleming and Souganidis [11] they allow the controls to depend on the 

past and prove with a Girsanov transformation argument that the priori random value functions 
are deterministic. Buckdahn, Hu and Li [9] extended the approach developed in [10] to SDGs 
with jumps, while Biswas [5] investigated two-player zero-sum SDGs with jump-diffusion in the 
sense of Fleming and Souganidis [11]. The reader interested in other approaches can be also 
referred to Bayraktar and Poor [3], Hamadene [12], Karatzas and Zamfirescu [14], Tang and 
Hou [23], and the references therein. 

In nonzero-sum SDGs, Hamadene, Lepeltier and Peng [13] obtained the existence of a Nash 
equilibrium point for nonzero sum SDGs with the help of BSDEs. Bessoussan and Frehse [4] and 
Mannucci [19] obtained Nash equilibrium payoffs for SDGs by using parabolic partial differential 
equations. But both methods rely heavily on the assumption of the non degeneracy diffusion of 
the coefficient and it is independence of controls. Buckdahn, Cardaliaguet and Rainer [7] got rid 
of the strong assumptions on the diffusion coefficient. In Lin [16], we generalize the result in [7] 
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by investigating Nash equilibrium payoffs for nonzero-sum SDGs with nonlinear cost functionals. 
However, in [16] the cost functionals of the both players are defined by a system of decoupled 
BSDEs. An open problem was how to study SDGs whose cost functionals are defined by two 
coupled BSDEs. This is the objective of this paper. Our method is based on an implementation 
of the approach by Pardoux, Pradeilles and Rao [20] into the framework of SDGs. 

Let us be more precise now: The dynamics of our two-player nonzero-sum SDG is given by 
the process N t,% and the following doubly controlled stochastic system: 

f dXl' x ' u ' v = b(s,X t s ' x ' u ' v ,u s ,v s )ds + a(s,X t s ' x ' u ' v ,u s ,v s )dB s , s £ [t,T], 

I X t = x, 

where {B t }t>o is a d-dimensional standard Wiener process, {A^}f>o is a Poisson process inde- 
pendent of {Bt}t>o, and F is the filtration generated by B and N. For < s < t < T, i = 1, 2, 
we let Ng l = m(i + N s — Nf), where m(j) = 1, if j is odd, and m(j) = 2, if j is even. The 
control u = {u} se [ t ^] (resp. v = {v} se [ t ,T]) is supposed to F-predictable and takes its values in 
a compact metric space U (resp. V). The set of these controls is denoted by Ut^T (resp. V^t)- 
We shall give its assumptions on b and a in the next section. 

We define our nonlinear cost functionals by introducing a system of two coupled BSDEs: 

' -d l Y s = h{a,X$*™°, X Y S , 2 Y S + 2 H S , l Zs lUs ,v s )ds - x Z s dB s - l H s dN s , 
< ~d 2 Y s = f 2 {s,X t s ' x ' u > v , l Y s + l H s , 2 Y s , 2 Z s ,u s ,v s )ds- 2 Z s dB s - 2 H s dN s , (1.1) 
X Y T = 2 F T = $ 2 (4 W ), sG[f,T], 

The assumptions on <E>j and fi, i = 1,2, will be given in the next section. The cost functional 
for the i th player, i = 1,2, is defined by 

Ji(t,x;u,v) := iy^ v , (t,x) G [0,T] x R n , 

where ( ty*.*;*.^ ^z t ' x ' u ' v , iH t ' x ' u ' v ),i = 1,2, is the unique solution of (1.1). Note the special 
form of fi and which is related with our approach. The general case of fi not depending on 
% H is still open. 

In our framework, in opposite to zero-sum SDGs, nonzero-sum SDGs are of the type of "NAD 
strategy against NAD strategy": an NAD strategy is a measurable, nonanticipative mapping 
o : Vt,T —> Utp for the 1 th player (resp. (3 : Ut,T Vt,T fo r the 2 th player) and has a delay (The 
precise definition will be introduced in next section). The set of all such NAD strategies for 1 th 
player is denoted by At,T (resp. for 2 th player is denoted by B^t)- 

For (a, (3) G At,T x Bt.T-, there exists a unique couple of controls (u, v) G Ut,T x Vt,T such 
that (a(v), j3(u)) = (u,v). This allows to define Ji(t,x;a, f3) := Jj(t, x;u,v), as well as the value 
functions of the two-player zero-sum SDG associated with Ji,i = 1,2, the lower value function 

Wi(t,x) := esssup Qg ^ iT essinf£ e B tT Ji(i,2;;a!,/3), 

and the upper value function 

Ui(t,x) := essm{p eBt T esssup aeAt T Ji(t,x;a,P),i = 1,2. 

We note that, since the BSDEs (1.1) are coupled, the values of the two-player zero-sum SDGs 
are also coupled. 

Pardoux, Pradeilles and Rao [20] gave a probabilistic interpretation of a coupled system 
of semi-linear parabolic partial differential equations, and Buckdahn and Hu [8] obtained a 
probabilistic interpretation of a coupled system of Hamilton-Jacobi-Bellman equations. In our 
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approach we need a probabilistic interpretation of coupled systems of Hamilton- Jacobi-Bellman- 
Isaacs equations: A first result of this paper is that the value functions U = (Ui,U 2 ) and 
W = (Wi, W 2 ) are viscosity solutions of the following coupled Isaacs equations: 

^U i (t,x) + H+(t,x,U 1 (t,x),U 2 (t,x),DU i (t,x),D 2 U i (t,x)) = 0, (t, x) G [0, T) x W 1 , 

Ui(T,x) = $i(x), i = 1,2, 

and 

^ i (t,x) + Fr(t,r E ,iy 1 (t,x),^ 2 (t,x), J D^(t, 2; ), J D 2 ^(t,x)) = 0, (t, x) G [0, T) x M n , 

Wi(T,x) = $*(x), z = 1,2, 

respectively, where, for (t,x,yi,y 2 ,p,A,u,v) e[0,T]xR"xlxRxK' i x§' i xf/xV, 
H i (t,x,y 1 ,y 2 ,p,A,u,v) = ^tr(aa T (t,x,u,v)A) +pb(t,x,u,v) + %(t,x,yi,y 2 ,pa(t,x,u,v),u,v), 
and 

H^(t,x,yi,y 2 ,p,A) = sup inf Hi(t, x, yi, y 2 ,p, A, u, v), 
Hf(t,x,y 1 ,y 2 ,p,A) = inf sup H^t, x, y±, y 2 ,p, A, u, v). 

A crucial step in the proof of this results is a dynamic programming principle for stopping times: 
For any stopping time r with < t < r < T, x £ M n , i = 1, 2, 

Wi(t,x) = esssup aeAiT essinf^ t , T J G^ ;Q ^[^M(r,X^^^)], 
I7i(*,x) = es S inf^ Bt)T esssu PaeAi /G'g ;Q ^[C/^, i (T,^ a: '^)], 

where *G^' Q,,3 [-] is a backward stochastic semigroup (the precise definition as well as those of 
At, T and Bt, T will be given later). 

The most important part of this paper is dedicated to the Nash equilibrium payoffs of our 
games. A couple (ei,e 2 ) G M 2 is called a Nash equilibrium payoff at the point (t,x), if for any 
e > 0, there exists (a e ,/3 e ) G At,T X £>t,T such that, for all (a, 0) G At,T X £>t,T, 

Ji(t,x;a £ ,/3 £ ) > Jx(t,x',a,^ e ) - e, J 2 (t,x;a e , f3 e ) > J 2 (t,x;a e , fi) - e, P- a.s., 

and 

|E[J i (t,s;a e , i 8 e )]-e i |<e, J = l,2. 

The main results of this paper concerns the existence and a characterization of Nash equi- 
librium payoffs for our games: Under Isaacs condition (which will be precised later), a couple 
(e±,e 2 ) G P 2 is a Nash equilibrium payoff at point (t,x) if and only if for all e > 0, there exists 
(u £ ,v £ ) G Ut,T x Vt,T such that for all stopping time r independent of T% with r G and 
J = 1,2, 

p( *&Y**\*<* > W^r, X*^'" 8 ^) - e I J" t ) > 1 - e, P - a.s., 

and 

|E[Jj(i, x;?/,?^)] — ej| < e. 
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This result turn out to be the key of the proof of a Nash equilibrium exists, for all (t, x) 6 
[0,T] x R n . 

Let us explain what is new and which difficulties are related with. In comparison with [7] 
and [16], the first difficulty was to get a dynamic programming principle for a system of two 
coupled BSDEs. To overcome this difficulty, we associate with this system an auxiliary one 
which cost functionals coincide with ours. This leads to the new problem is that we need a 
dynamic programming principle for this system not only for deterministic but also for stopping 
times. The method used in Buckdahn and Hu [8] to get for control problems the dynamic 
programming principle on stopping times is not applicable any more, because in the framework 
of SDGs the monotonicity arguments used in [8] doesn't work any more. Another technical 
difficulty comes from the fact that we study here nonzero-sum SDGs and not zero-sum SDGs. 
In order to give both players symmetric tools, they have to use "strategies against strategies" 
and not only "strategies against controls" as in [10]. Finally, comparing to our previous work 
[16], the presence of jump terms adds a supplementary complexity. And related works see [17] 
and [18]. 

This paper is organized as follows. In Section 2 we introduce some notations and recall some 
basics of BSDEs with jumps, which will be needed in what follows. Section 3 introduces the 
setting of SDGs and studies the dynamic programming principle for stopping times. Section 
4 gives a probabilistic interpretation of coupled systems of Isaacs equations. In Section 5 we 
investigate Nash equilibrium payoffs for nonzero-sum SDGs. An existence theorem and a char- 
acterization theorem of Nash equilibrium payoffs are established. Finally, we postpone the proof 
of the Theorems 3.10 and 4.2 to Section 6. 

2 Preliminaries 

The objective of this section is to give some notations and to recall some basic results of 
BSDEs with jumps, which will be useful in what follows. 

Let (Q, F, {J^loo, P) be a complete probability space. The filtration F = {J-~t}t>o is gener- 
ated by the following two stochastic processes defined on (f2, J 7 , P), and augmented by all P-null 
sets: 

• {Bt}t>o is a c?-dimensional standard Wiener process; 

• {N t }t>o is a Poisson process independent of {B t }t>o such that {N t = N t — \t}t>o is an 



martingale, for some A > 0. 
Let T > be an arbitrarily fixed time horizon. For any n > 1, we denote by \z\ the Euclidean 
norm of z G M n . We introduce the following spaces of stochastic processes. 



{^t}t>o- 



is an J^-measurable random variable such that 





(p | if : Q x [0, T] — > ]R is an F-adapted cadlag process such that 
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Let us consider the following BSDE with data (/,£): 

yt = Z+ [ f(s,y s ,z s ,k s )ds- [ z s dB s - f k s dN s , < t < T. (2.1) 
Jt Jt Jt 

Here / : S7 x [0, T] x R x R d x R — > R is F— predictable and satisfies the following assumptions: 
(if 1) (Lipschitz condition): There exists a positive constant C such that, for all (t, yi, Zi, ki) G 
[0,^x8x^x1,1 = 1,2, 

- f(t,y 2 ,z 2 ,k 2 )\ < C{\yi - y 2 \ + \zi - z 2 \ + \h - k 2 \). 

(H2) /(•, 0,0,0) G^ 2 (0,T;R). 

(H3) There exists a constant K > -1 such that, for all (t, y, z, fci, fc 2 ) G [0, T] x R x R d x R 2 , 

f(t,y,z,kx) - f(t,y,z,k 2 ) < K(ki - k 2 ). 

We have the following existence and uniqueness theorem of BSDE (2.1). For its proof we 
refer the reader to Tang and Li [24]. 

Lemma 2.1. Let the assumptions (HI) and (H2) hold. Then, for all £ G L 2 (Q, Ft, P; R), 
55D^ (^.ij /ias a uraigue solution (y,z,k) G S 2 (0,T;R) x % 2 (0,r;R d ) x % 2 (0,T;R). 

We have the following comparison theorem for solutions of BSDEs (2.1), which is proved 
with the help of standard arguments (see Royer [22]). 

Lemma 2.2. Let us denote by (y , z 1 , k 1 ) and (y 2 , z 2 , k 2 ) the solutions of BSDEs with data 
(f 1 ,^ 1 ) and (/ 2 )C 2 ); respectively. Moreover, i/C 1 ,^ 2 G L 2 (Q, Ft, P; R), and f 1 and f 2 satisfy 
the assumptions (HI), (H2) and (H3), and the following holds 

(ije <e, F-a. s ., 

(ii) f\t, y 2 , z 2 , k 2 ) < f 2 (t, y 2 , z 2 , k 2 ), dtdP - a.e, 
then we have y\ < y 2 , a.s., for all t G [0, T]. 

For some / : ft x [0, T] x R x R d x R -> R satisfying (HI) and (F2), we let, for % = 1, 2, 
/i(s, yl, zj, fcj) = /(a, yl, z*, *£) + 
where G H 2 (0,T;M). If & and & 

are in L 2 (ft, .Fy, P; R), then we have the following lemma. 

Lemma 2.3. Let us denote by (y ,z ,k ) and (y 2 ,z 2 ,k 2 ) the solutions of BSDE (2.1) with the 
data f\) and (£2, f 2 ), respectively. Then the following holds: for all t G [0, T], 

\Vt ~ Vt\ 2 + \n[e^(\y\ - y 2 s \ 2 + \z\ - z 2 \ 2 )ds\F t ] + ^[j\^\kl - k 2 s \ 2 ds\F t ] 

< E[e^ T -')|£! - ^ 2 \ 2 \F t ]+E[j\^\Ms) ~ V2 (s)\ 2 ds\F t ], P - a.s. 

Here (3 > 2 + 2C + 4C 2 , where C is the Lipschitz constant in (HI). 

For the proof, the readers can be referred to Barles, Buckdahn and Pardoux [1]. 
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3 Stochastic differential games with jumps 

In this section, we first introduce nonzero-sum SDGs, and then we define the value functions 
and show that they have a deterministic version. Finally, we state the dynamic programming 
principle for stopping times, which is crucial for the next section. 

Let U (resp., V) be the set of admissible control processes for the first (resp., second) player, 
i.e., the set of all U (resp., y)-valued F-predictable processes. We suppose that the control state 
spaces U and V are compact metric spaces. 

For given admissible controls u(-) G Li and v(-) G V, we consider the following stochastic 
differential equation (SDE): for t G [0,T] and ( G L 2 {Q, T u P; R n ), 

J dX t s ^ ,u ' v = b{s,X t s ' C " u,v ,u s ,v s )ds + a{s,X t s ' C " u,v ,u s ,v s )dB s , se[t,T], , , 

\ x^ = c, ( } 

where 

b : [0, T] x M n x U x V -> R n , a : [0, T] x W 1 x U x F -> R nxd , 
satisfy the following assumptions: 

(i) For every fixed x £ R n , &(., x, ., .), and cr(., x, ., .) are continuous in (i, n, u). 

(ii) There exists a constant C > such that, for all t G [0, T], G M n , u £ U, v G V, 

x, n, d) — 6(t, x', tt, u)| + |cr(t, x, n, v) — a(t, x' , u,v)\ < C\x — x'\. 

{HA) 

From {HA) we know that there exists some C > such that, for all < t < T, u G U, v G 

V, x G M n , 

x, u, «)| + |cr(t, x, u, v)\ < C(l + |x|). 

It is well known that under {HA), for any it(-) G W and v{-) G V, SDE (3.1) has a unique strong 
solution. Furthermore, we have the following estimates for the solution of SDE (3.1) (e.g., see 
[9])- 

Proposition 3.1. Let the assumption {HA) hold. Then, for p > 2, there exists a positive 
constant C = C p such that, for t G [0,T], u{') G U,v{-) G V and (,(' G L 2 {n,T t ,F;R n ), 

E[ sup \X l /' u ' v - X*' ? ' ;n T| F t ] < C\( - CT, P - a.s., 
se[t,T] 

E[ sup \X l /' u ' v -C\ p \F]<C{l + \C\ p )\T-t\2, F-a.s. (3.2) 
se[t,T] 

For given ^ : M. n -»• R, ^ : [0, T] x M n x M 2 x P d x U x V -)■ R, i = 1,2, we make the 
following assumptions: 

(i) For every fixed (x, y, z) G R n x M 2 x R d x R, /j(., x, y, z, ., .) is continuous in 
(t,u,v) and there exists a constant C > such that, for all t G [0, T], x,x' G R n , 
y, y' G R 2 , z, G R d , u £ U and weV, 

|/i(£,x,2/,z,it,u) - fi{t,x',y',z',u,v)\ < C{\x - x'\ + \y - y'\ + \z- z'\). 

(ii) For all (yt, y 2 ), {y[, y' 2 ) G R 2 ,and {t,x,z,u,v) G [0, T\ x R n x R d x ?7 x V, 
there exists a constant K > — 1 such that 

h{t,x,yi,y 2 ,z,u,v) - fx{t,x,y u y' 2 ,z,u,v) > K{y 2 -y' 2 ), 
f2{t,x,yi,y 2 ,z,u,v) - f 2 {t,x,y[,y 2 , z,u,v) > K{y 1 -y[). 

(iii) There exists a constant C > such that, for all x, x' G R n , i = 1, 2, 

|$;(x) - $i(x')| < C|X-X'|. 

(^5) 
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The following system of two coupled BSDEs will define the cost functionals of the game associ- 
ated with (3.1). 

' -d l Y s = h(s,X t s ' x ' u ' v , 2 Y S + 2 H S , 1 Z s ,u s ,v s )ds-X 1 H s ds- 1 Z s dB s — x H s dM„ 
< ~d 2 Y s = f 2 (s,X^ x ' u ' v , 1 Y S + l H s , 2 Y s , 2 Z s ,u s ,v s )ds- X 2 H s ds- 2 Z s dB s - 2 H s dN s , (3.3) 

1 y t = 2 y T = $ 2 (4 w ), s6 [t,T], 

where X ' x ' u ' v is the solution of equation (3.1) with ( = x G M. n . Under the assumption (H5), 
from Tang and Li [24] we know that equation (3.3) has a unique solution. For given control 
processes u(-) G U and v(-) G V, we introduce now the associated cost functional for the i th 
player, i = 1,2, 

Ji(t,x;u,v) : = (t,x) G [0,T] x R n , 

where Z t ' x ' u ' v , H l ' x ' u ' v ) is the solution of (3.3). 

In the above definition we generalize the framework studied by Lin[16]. Indeed, in [16] we 
studied cost functionals defined by a decoupled system of BSDEs, while now the both BSDEs 
are coupled: the both players do not only influence mutually their cost functionals in the choice 
of their control processes, but also their gain processes l Y t ' x ' u > v ,i = 1,2. With an argument 
introduced in Pardoux, Pradeilles and Rao [20] we can transfer the coupled system of BSDEs 
to a decoupled system of BSDEs. For < s < t < T, i = 1, 2, we denote by N((0, s]) := N s and 
N((t,s]) := N s - N t . Let us define a Markov process N*/ as follows: N 1 / = m(i + N((t,s})), 
where m(j) = 1, if j is odd, and m(j) = 2, if j is even. 

For (t, x, y, h, z, u, v) G [0, T] x R n x E x R x R d x U x V, we define 

fl(t, x, y, h, z, u, v) := fi(t, x,y,y + h, z, u, v), 
f 2 {t, x, y, h, z, u, v) := f 2 (t, x,y + h, y, z, u, v), 

and we consider the following controlled decoupled BSDEs with jumps: for i = 1,2, 

( _cpy s *™ = f Nl ^ s ^xl' X]U ' v , iYp x ' u > v , iHt' x ' u ' v , i Z t s ' X]U ' v ,u s ,v s )ds, 
I _ A S i H t,x;u,v ds _ i Z t,x;u,v dBs _ i^PW^ S G [t, T], (3.4) 

i Y t,x;u,v = $ 

Since fi,i = 1,2, are Lipschitz in (x,y,z), uniformly with respect to (t,u,v), it is easy to 
check that also the coefficients fi,i = 1,2, have this property. From Lemma 2.1 we know that 
the above BSDE has a unique solution. In what follows we choose the intensity A > such that 
K — A > —1. It follows from Lemma 2.2 that the comparison theorem for the BSDE (3.4) holds. 
Moreover, we also have the following propositions. 

Proposition 3.2. Let the assumption (H5) hold. Then we have, for s G [t,T],i = 1,2, 

i-yt,x;u,v Ml'* -y~t,x;u,v 

ijjt,x;u,v _ m(7V^+l) jjt,x;u,v _|_ m(7V^+l)yt,:r;«.« _ JV*^ yt,a:;it,«; 

In particular, we have l Y^' x ' u ' v = ^y^' x ' u ' v , i.e., Ji(t,x;u,v) = l Y^' x ' u ' v . 

Proof. We consider the solution i^.*;".^ = i^, of equation (3.3) and, 

suppressing for simplicity the superscript (t,x,u,v), we put 

%= N ' i: Y s , i Z s = N °' l Z s , i H s = m ( N t'-+ 1 )H s + ^s'+^Ys.- ^-y a _, s€[t,T\. 
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Then, obviously, ^Y, l Z, i H) G S 2 (0,T;M) x H 2 (0,T;R d ) x H 2 (0,T;R). Moreover, setting 
tq = t and 

77 = inf Is > t, N((t, s]) =iJaT,I>1, 

we have, on stochastic interval ]]t"0j t i[[j 

-d X Y S = -d X Y S = fi(s,X s , l Y s , 2 Y s + 2 H s , 1 Z J ,u s ,v s )ds - x Z s dB s ^ 

= fi(s,X s , l Ys,( 2 Y s - 1 Y S + 2 H s )+^ l Y s , l Z s ,u s ,v s )ds- 1 Z s dB s 

= fi(s,X s , l Y s , 2 Y S - l Y s + 2 H S , 1 Z s ,u S) v s )ds- l Z s dB s 

= fi(s,X s , l Y s , 1 H S , l Z s ,u s ,v s )ds - l Z s dB s . 

On the other hand, analysing the jump hight of 1 Y at t\, we get 

a l Y n = l Y T1 - = ( 2 y T1 - 1 y T1 _)Aiv ri 

= ( 2 H T1 + 2 y T1 _ - 1 y T1 _)Aiv T1 = x h t ^n ti . 

Consequently, ( 1 y, 1 Z, 1 H) solves (3.4) over the interval [[to,ti]], with 1 y ri = Ns ' Y Tl . By iter- 
ating this argument and arguing in a similar way for i = 2, we complete the proof. Indeed, from 
the uniqueness of BSDE (3.4) it follows that ( i y*' w , = ( i y, i Z, i H),i = 

1,2. □ 

From standard BSDEs estimates we have the following: 

Proposition 3.3. There exists some constant C > such that, for all < t < T, x, x' G 
R n , u(-) G U and v(-) G V, 

I *Y?> X > U > V - iy*' x '' u ' v \ < C\x -x'\, I < C(l + \x\), P - a.s. 

Let us now introduce subspaces of admissible controls and give the definition of NAD strate- 
gies. For later applications this has to be done for games over stochastic intervals. Let a, r be 
two stopping times such that t < a < r < T. 

Definition 3.4. The space U ajT (resp. V a , T ) of admissible controls for 1 th player (resp., 2 th 
player) over the given stochastic time interval [[a, r]] is defined as the space of all processes 
{u r ,a < r < t} (resp., {v r ,a <r<r}), such that, for uq G U, the process {u r l[ a ^ + uol^^c} 
(resp., for vo G V, the process {v r lu T j + v^l^^c}) are ¥ -predictable and take its values in U 
(resp., V). 

Definition 3.5. A nonanticipating strategy with delay (NAD strategy) for 1 th player over the 
given stochastic time interval [[c, r]] is a measurable mapping a : V ct ,t — > M<j,t, the following 
properties hold: 

1) a is a nonanticipative strategy, i.e., for every F-stopping time r' on Q with a < r' < r, 
and for all V\,V2 G V a , T with v\ = vi on [[a, t']], it holds a{v\) = a{v2) on [[a, t']]. (The 
identification of v\ = V2 and a{v\) = a{v2) is in the dsdF almost everywhere sense.) 

2) a is a nonanticipative strategy with delay, i.e., for all v G V a ,r, there exists an increasing 
sequence of stopping times {S n (v)} n >i with 

1)0 = S (v) < Si(«) < ■ ■ ■ < S n (v) < • • • < t, ii) {j n ^{S n (v) = t} = U, F-a.s., 
suchthat, for all T G T a and for alln > 1 andv,v' G V a)T , itholds: ifv = v' on [[a, S n -i(v)]] 
[t,T]), then Hi) Si(v) = Si(v'), on T, F-a.s., 1 < I < n, 

iv) a(v) = a{v'), on [[a, S n (v)}} f\(T x [t, T]). 

We denote by all such NAD strategies for 1 th player A a , T - We can define all NAD strategies 
P : lAfj^ — > V a , T for 2 th player symmetrically and denote by B a:T . 
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We have the following lemma, which turns out to be useful in what follows. Since the proof 
of this lemma is similar to that in Lin [16], we omit it here. 

Lemma 3.6. For (a, (3) G A.t,TxBt,T> there exists a unique couple of admissible control processes 
(it, v) G U-a,r x V(j,t such that a{v) = u, f3(u) = v. 

For (a, [3) G At.T x Bt,T, it follows from Lemma 3.6 that there exists a unique couple of 
controls (it, w) G Ut,T X Vt,T such that (a(v), (3(u)) = (u,v). In this sense, we define 

t,x;a,/3 £-j^t,a:;a,/3 i ^t,x;a,/3 i jjt,x;a,f3^ ^j^t,x;u,v iYt,x;u,v i^t,x;u,v i jjt,x;u,v^ 

and Ji(t,x;a, 0) := Ji(t, x;u, v). This definition allows, in particular, to define the value func- 
tions Wi and Ui of the game: For all (t, x) G [0, T] x R n , we put 

Wi(t,x) := esssup aeAtT essinip eBtT Ji(t,x;a,P), 
Ui(t,x) := essini /3(z Bt T esssup aeAt T Ji(t, x; a, (3) . 

The functions Wi and Ui,i = 1,2, are called the lower and upper value functions, respec- 
tively. Observe that, according to the definition of esssup and essinf over a uniformly essentially 
bounded family of JVmeasurable random variables, both Wi(t,x) and Ui(t,x) are a priori ele- 
ments of L°°(n, J-f,P). However, we will prove that they are deterministic. 

Proposition 3.7. Let the assumptions (HA) and (H5) hold. Then, for any (t,x) G [0, T] x R n , 
we have Wi(t,x) = E[Wi(t,x)], and Ui{t,x) = E[Ui(t,x)], P- a.s., i = 1,2. 

This proposition allows to identify Wi(t, x), Ui(t, x) with the deterministic functions E[Wj(i, x)], 
M[Ui(t,x)], respectively, i = 1,2. The following lemma indicates that W{ is invariant by a large 
class of transformations on £1. The proposition follows then by a similar argument as in [9] 
Lemma 3.2. 

Lemma 3.8. For (t, x) G [0, T] xlR n , r : — )• is an invertible T—T measurable transformation 
such that 

i) t and t" 1 : — )■ are Ft — J~t measurable; 

ii) (B s - B t ) o r = B s - B t , s G [t, T], N((t, s])o T = N((t, s}), s G [t, T]; 

the lawFo [r]" 1 of t is equivalent to the underlying probability measure P, 

then Wi(t,x) o r = Wi(t,x), P-a.s. 

Even if the formulation of of the lemma is the same as in [9], the proof is more difficult here. 
Indeed, in [9] games of the type "strategy again control" were studied, while we investigate here 
games of the type " NAD strategy against NAD strategy" . 

Proof. : We give the proof in four steps: 

Step 1: For any u G Ut,T, v £ V^t, Ji(t, x; it, v) o r = Jj(i, x; u(r), v(t)), P-a.s. 

The proof follows closely from the arguments in [9] or [10] and is therefore omitted. 

Step 2: For (3 G B t ,T, let f3(u) := /3(n(r~ 1 ))(r), u G U t ,T, and for a G A t ,T, let a(v) := 
a(i;(r~ 1 ))(r), v G V t ,r- Then, ft G B t ,T and a G A t .T- 

We only give the proof for /3, since we can use a similar argument for a. From the definition 
of (3 we know that j3 maps Ut t into Vt,T- 

(1) /3 is a nonanticipative strategy. Indeed, let a : Q — >■ [t,T] be an F-stopping time and 
Ul,it2 G Wt,T such that u\ = U2 on [t, a]. Since t(F s ) ■= {r(A), A G -Fs} = F s , s G [i, T], 
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the assumptions i) and ii) imply that cr(r 1 ) is still an F-stopping time. Obviously, we have 
mir" 1 ) = u 2 (t~ 1 ) on [[t, ^(t- 1 )]]. From /3 G B t>T it follows that P( Ui {t~ 1 )) = ^(^(r" 1 )) 
on [[i, (^(r" 1 )]]. Consequently, 

j8(ui) = ^(^(r- 1 ))^) = P{u 2 {t- 1 )){t) = P{u 2 ) on [[t, a}}. 

(2) f3 is a nonanticipative strategy with delay. Since f3 is a nonanticipative strategy with delay, 
we have, for all u G W^t, the existence of an increasing sequence of stopping times {S' n (u)} n >i 
with 

(a) t = S f (u) < S[(u) < < S' n {u) < ■■■ <T, 

(b) IWM = T} = n, P-a.s., 

such that, for all r G Tt and for all n > 1 and it, u' G Z^t, it holds: if u = u' on [[i, f^|(rx 
[t,T]), then 

(c) Sftu) = Sfcu'), on T, P-a.s., 1 < I < n, 

(d) = £(«'), on [t,54(«)]]n(r x [t,T]) : 

For all u G Z^r, we put S n (u) = S' n {u{r 1 ))(r),n > 1. It is easy to check that (3 is a 
nonanticipative strategy with delay. Moreover, since /3(«) = /3(m(t))(t -1 ), it G W^t, we have 
that {(3 | /3 G #t, T } = S t) T- Ditto for S. 

Step 3: For all a G ^4t,T we have: 

^esssup ae _4 ( T essinfs e B t , T Jifa x 'i a ' Z 3 )) ( T ) = esssu Pae-4 t ,T essmf ^eB t>T \Ji(t, x; a, /3)(t)J , P-a.s. 

Taking into account the properties of r, this relation can be proven in the same manner as the 
corresponding relation in [10], also see [6]. 

Step 4: We now show that Wi(t,x)(r) = Wi(t,x), P-a.s. 

Let (a, (3) G At,T x Bt,T- Then there exists a unique couple (u, v) G lit,T x Vt,T such that 
a(v) = u,(3(u) = v. Consequently, due to Step 2, a(v{r)) = u{t) and /3(u(t)) = v(t), and, thus, 
from Step 1, 

Ji(t,x;a,/3)(r) = Ji(t,x;u,v)(r) = Ji(t, x; u(t), v(t)) = Ji(t,x;a,(3), P- a.s. 
Thus, since {a \ a G At^r} = <At,T and {/3 | /3 G Bt t r} = &t,T, we conclude with Step 3, 

Wi(t,x)(r) = esssup aeAt T essin£/3 e B ttT (Ji(t,x; a, /3)(t)) 

= essswp aeAt T essmfp eBt T Ji(t, x; a, fi) 

= esssup a€u4t T essinip eBt T J»(t, x; a, /3) 

= Wi(t,a:), P-a.s. 

We get the wished result. □ 

By the definition of Wi(t, x) and Proposition 3.3 we can easily get the following properties 
for our deterministic function W%. The same proposition holds for 

Proposition 3.9. Under the assumptions {HA) and (H5), there exists a constant C > such 
that, for allO < t < T, x, x' G R n , 

\Wi(t,x) - Wi(t,x')\ < C|x-x'|, \Wi(t,x)\ < C(l + |x|). 
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We now recall the notion of stochastic backward semigroups, which was first introduced by 
Peng [21] to study stochastic optimal control problems, and translated later by Buckdahn and 
Li [10] to SDGs. For any stopping times a, r, with t < a < r < T, and a random variable 
r) G L 2 (n, J" r ,P;M), we define 

where ( *Yp x ' u > v , *zl> x ' u > v , ^H l s ' x ' u ' 1 )t<s<r is the solution of the following BSDE: 

-A i H t s ' x '' u,v ds - tzl'^dBs- l Hi' X]U ' v dN s , 

1 T — '/) 

where X l > x > u > v is the solution of SDE (3.1) with ( = i£ R n . 

We have the following dynamic programming principle (DPP) over a stochastic interval for 
our games. 

Theorem 3.10. Let the assumptions {HA) and (H5) hold. Then the following dynamic pro- 
gramming principle holds: For any stopping time r with < t < r < T, x £ R™, i = 1,2, 

Wi(t,x) = e S «p a6A/ 5 S 4 6Bl /G;f^[^4r,I^^)], 

Ui(t,x) = e»^ ft/ »j )ftgA /Gif'> ;f «(T 1 ^^)]. 

This DPP for stopping times will play a crucial role in Section 4. Since the proof is rather 
long and technical, we postpone it to Subsection 6.1. 



4 Probabilistic interpretation of associated coupled systems of 
Isaacs equations 

The objective of this section is to give a probabilistic interpretation of coupled systems of Isaacs 
equations. More precisely, we show that the value functions U = (U±,U 2 ) and W = (W±, W 2 ), 
introduced in Section 3, are viscosity solutions of the following coupled Isaacs equations: 

f ^U i (t,x) + H?{t,x,U 1 (t,x),U 2 {t,x), DU % {t, x),D 2 Ui(t,x)) = 0, (t, x) G [0, T) x R n , ^ 
1 Ui(T,x) = $i(x), z = 1,2, 

and 

f ^W l (t,x) + H7(t,x,W 1 (t,x),W 2 (t,x),DW l (t,x),D 2 W l (t,x)) = 0, (t, x) G [0, T) x R n , (42) 
1 Wi(T,x) = * = 1,2, 

respectively, where for (t,x,y 1 ,y 2 ,p, A,u,v) G [0, T] x R™ x R x E x R d x S d x C7 x V, 
H i (t,x,y 1 ,y 2 ,p,A,u,v) = ^tr(aa T (t,x,u,v)A) +pb(t,x,u,v) + fi(t,x,yi,y 2 ,pa(t,x,u,v),u,v), 

H^(t,x,y 1 ,y 2 ,p,A) = sup inf Hi(t,x,yi,y 2 ,p, A,u,v), 
H?(t,x,yi,y 2 ,P,A) = MswpHi(t,x,yi,y 2 ,p,A,u,v). 

Let us recall the definition of a viscosity solution of the system (4.1). We denote by C? b ([0, T] x 
R n ) the set of real- valued functions which are continuously differentiable up to third order and 
whose derivatives of order from 1 to 3 are bounded. 
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Definition 4.1. A continuous function V = (V 1 ,V 2 ) G C([0,T] x R n ;R 2 ) is raZZed 

(i) a viscosity subsolution of the system (4-1) ifVi(T,x) < 3>i(x), /or a// i = 1,2, x G R n , and 
/or a// test functions ip G C^ 6 ([0,T] x R n ),i = 1,2, and (t,a?) G [0,T) x R n such that Vt - tp 

attains a local maximum at (t,x), 

d 

—cp(t,x) + Hf(t,x,V 1 (t,x),V 2 (t,x),D<p(t,x),D 2 <p(t,x)) > 0, (4.3) 

(ii) a viscosity supersolution of the system (4-1) ifVi(T,x) > $i(x), for alii = 1,2, x G R n , and 
if for all functions tp G Cf b ([0, T] x R n ), i = 1, 2, and (t, x) G [0, T) x R n suc/i that Vi — <p attains 
a local minimum at {t,x), 

d 

—cp(t,x) + H+(t,x,V 1 (t,x),V 2 (t,x),D<p(t,x),D 2 <p(t,x)) < 0, (4.4) 

(iii) a viscosity solution of the system (4-1) if it is both a viscosity subsolution and a supersolution 
of the system (4-1)- In the same way we can define a viscosity solution of the system (4-2). 

We now give the main result in this section. We shall give the proof in Section 6.2 since it 
is rather lengthy. 

Theorem 4.2. Let the assumptions (H4) and (H5) hold. Then U = (JJ\,U2) (resp. W = 
(Wi,W2)) is a viscosity solution of the system (4-1) (resp. (4-2)). 

To state a uniqueness theorem for the viscosity solution of the system (4.1), let us first define 
the following space: 



G : = G C([0, T] x K n ) : there exists a constant A > such that 

lim \ip(t,x)\ exp{-A[log((|x| 2 + l)^)] 2 } = 0, uniformly in t G [0, T}\. 

\x\— >OD J 

Theorem 4.3. Let the assumptions (HA) and (H5) hold. Then there exists at most one viscosity 
solution u G Q (resp. v G Q) of the system (4-1) (resp. (4-2))- 

The proof of the Theorem can be adapted from the arguments in Barles, Buckdahn and 
Pardoux [1] combined with those of Barles and Imbert [2] to our framework. We omit it here. 

Remark 4.4. Since U = (U\, U 2 ) (resp. W = (W±, W 2 ) ) is a viscosity solution of linear growth, 
U = (U\,U 2 ) (resp. W = (W±,W 2 )) is the unique viscosity solution in G of the system (4-1) 
(resp. (4-2)). 

An immediate consequence of this remark is that, under Isaacs condition: 

For all (t, x, y\,y 2 ,p, A, u, v) G [0, T] x W 1 x R x R x R d x S d x U x V, j = 1, 2, we have 



sup inf {-tr(aa T (t, x, u, v)A) + pb(t, x, u, v) + fj(t, x, yi, y 2 ,pa(t, x, u, v), u, v)\ 

= inf sup \\tr(aa T (t, x,u,v)A) +pb(t,x,u,v) + f j (t,x,y 1 ,y 2 ,pcr(t,x,u,v),u,v)\, 
v £Vu£U L 2 J 

the upper value and lower value functions coincide: 

Corollary 4.5. Let Isaacs condition hold. Then we have, for all (t,x) G [0, T] x R n ; 

(U!(t,x),U 2 (t,x)) = (Wi(t,x),W 2 (t,x)). 



(4.5) 
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5 Nash equilibrium payoffs for nonzero-sum stochastic differen- 
tial games with coupled cost functionals 

The objective of this section is to investigate Nash equilibrium payoffs for nonzero-sum SDGs. 
An existence theorem and a characterization theorem of Nash equilibrium payoffs are obtained. 

In all what follows we assume that the Isaacs condition (4.5) holds, and that all the coeffi- 
cients are bounded. This latter assumption is not necessary, but has the objective to simplify the 
arguments. Under the Isaacs condition (4.5), from Corollary 4.5, we have, for (t, x) £ [0, T] x R n , 

Wi(t,x) = esssup essinf J\(t, x; a, /?) = essinf esssup J±(t, x; a, f3), 

a€A t ,T P^ B t,T P<£B t ,T a&At.T 

W2(t,x) = essinf esssup J 2 (t, x; a, 13) = esssup essinf J 2 (t, x; a, (3). (5.1) 

We now give the definition of Nash equilibrium payoffs for nonzero-sum SDGs, which is 
similar to that in [7] and [16]. 

Definition 5.1. For (t,x) £ [0, T] x M. n , a couple (ei,e2) £ M 2 is called a Nash equilibrium 
payoff at the point (t,x), if for any e > 0, there exists a couple (a £l /3 £ ) £ At,T x &t,T such that, 
for all (a,P) £ A t ,T X B t) T, 

Ji(t,x;a e ,/3 £ ) > Ji(t,x;a,f3 e ) - e, J 2 (t,x;a e , f3 e ) > J 2 (t,x;a e , /3) - e, F-a.s., (5.2) 

and 

lE^-^^a^^^-e^l <e, i = 1, 2. 

Remark 5.2. We notice that unlike in [7] our cost functionals Jj(t,x;a, /3),j = 1,2, are not 
necessarily deterministic. Indeed, while [7] is based on the approach by Fleming and Souganidis 
[11] in which the admissible cost functionals for a game over the fixed time interval [t,T] are 
independent of J~t, the present paper is based on the approaches developed in [10], [6] and in [9]. 

The following equivalent condition of (5.2) follows easily from Lemma 3.6. 

Lemma 5.3. For any e > 0, let (a e ,/3 e ) £ At,T x &t,T- Then (5.2) holds if and only if, for all 
(u, v) £ U t ,T X V t ,T, 

Jt(t,x;a E ,/3 s ) > J\{t,x\u,[i e {u)) - e, J 2 (t, x; a £ , (3 e ) > J 2 (t, x; a e (v), v) - e, F-a.s. (5.3) 

As in [16], before giving the characterization theorem of Nash equilibrium payoffs, we first 
state two important lemmas. 

Lemma 5.4. For (t,x) £ [0, T] x R n , we fix arbitrarily u £ Ut,T- Then, 

(i) for all stopping time r £ [t,T] and e > 0, there exists an NAD strategy a £ At,T such 
that, for all v £ Vt,T, 

a(v) = u, on [[t, r]], 

2 Y t,x;a(v),v < W^T, X$ x ' a W' v ) + £, P - a.S. 

(ii) for all stopping time r £ [t,T] and e > 0, there exists an NAD strategy a £ At,T such 
that, for all v £ V^t, 

a(v) = u, on [[t, r]], 
l Y t,x;a(v),v > w X t,x;a(v),V} _ £> p _ a _ s _ 
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Proof. Let us only give the proof of (i); that of (ii) can be carried out in a similar argument. We 
notice that V Ty T can be regarded as a subset of B Tj t- Indeed, putting f3 v (u 1 ) = v' , v! £ M T ,T, we 
associate all v' £ V T ,T with some f3 v £ <6 T ,T- Therefore, for any y £ M n , from Proposition 6.13 
it follows that 

W M t,2(r, y) = essinf esssup J M t, 2 (r, y; a, f3) 

"t n (z A_ „ "t 



sssinf esssu x 



> essinf esssup J N t, 2 (r, y; a(v), v), F — a.s. 



Then, for any eo > 0, by standard arguments we have the existence of a y £ A t< t such that 

W N t,2(r,y) > esssup J N t,2(r,y; a y (v),v) — Eq, P — a.s. (5-4) 

t'6V T ,T T 

We let {Oi}i>i C B(R n ) be a partition of M n such that £ Oi = R n ,Oi / 0, and diam(Oj) < 

i>l 

Eq,i > 1. For y-i £ 0. t ,i > 1 and v £ Vt,T, let us set 

f u s , s £ [[t,r]], 

a ( v )s = \ EWgj^HM).. s 6 ]]t,T]]. (5-5) 

Then a : V^t — > Ut,T is an NAD strategy. This can be checked in a straight-forward way and is 
omitted in order to shorten the proof. 

By virtue of Proposition 3.9, (5.4) and (5.5), we deduce that, for v £ Vt,T, 

> l {x t T ' xMvhv £o,} w N t T ' 2 ( r ' y*) ~ Ce o 

i>l 

> ^ l {x ^Mv),v e0i} J N t,2(T,yi-,a yi (v\ [TiT] ),v) -Ce 
i>l 

= ^2^ x t,x }a (v),v e0i yJ N t,2(T,yi]a(v),v) -Ce . 

i>l 

Consequently, due to Proposition 3.3 we conclude 

i>l 

= J N t,2(T,X t T ^ a ^ v ;a(v),v)-Cs , 

where C is a constant which can be different from line to line and is independent of v £ Vt,T- 
Recalling that > hasn't been specified yet, let us choose £0 = C~ 1 e. We observe that 

J^T^X^^^-aiv)^) = ^r 2 Yr,Xr'' a{v) - V Hv),v = 2 Y t,x,a(v),v_ 

Then we deduce that W N t,2(r, x^ x,a ^' v ) > 2 Yr' x '° 1 — e, v £ Vt,T- This conclude the proof. 

□ 

The following lemma follows from standard estimates for SDEs. 

Lemma 5.5. There exists a positive constant C such that, for all {u, v), (u', v') £ Ut,T x Vt,T, 
and for all F-stopping times a : O — > [t, T] with xi' x,u,v = Xi ,x,u ' v , P — a.s., we have the 
following estimate: for all real r £ [t,T], 

Er I v t,x;u,v v t,x\u' , v 1 |2 rl / /i to 

[ Q sup r |* ( ;;; )AT - * ( ;; a) ' AT l H <Cr,F- a.s. 
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Let us now give the following characterization theorem of Nash equilibrium payoffs for two- 
player nonzero-sum SDGs. 

Theorem 5.6. For (t,x) G [0,T] x W 1 , a couple (ei,e2) £ M? is a Nash equilibrium payoff at 
point (t,x) if and only if for all e > 0, there exists a couple (u e ,v £ ) G Ut,T x VtT such that for 
all stopping time r(t < r < T) independent of Tt, and j = 1,2, 

p( rt'yfW,* > iy ff y( Ti iM;« £ .« £ ) _ £ | JFt) > 1 - e, P- a.s. (5.6) 

and 

IEIJj^zju 6 ,^)] -ej| < e. (5.7) 

Remark 5.7. XTie characterization theorem of Nash equilibrium payoffs in [16] generalizes the 
results in [7] from classical cost functionals without running cost to nonlinear cost functionals 
with running cost defined by decoupled BSDEs. The above theorem on its part extends the result 
in [16]: on one hand, we generalize [16] from SDGs without jumps to those with jumps. On the 
other hand, our cost functionals are defined by a system of two coupled BSDEs. 

Proof of Theorem 5.6: Necessity of (5.6) and (5.7). 

Proof. Let us suppose that (ei,e2) S I 2 is a Nash equilibrium payoff at the point (t,x). Then, 
by Definition 5.1 we have, for sufficiently small e > 0, the existence of (a £ ,[3 £ ) G At,T x &t,T 
such that, for all (a,/3) G At,T x Bt,T 

Ji(t,x;a £ ,(3 e ) > Ji(t,x;a,P e ) - e 4 , J 2 (t, x; a e , j3 e ) > J 2 (t, x; a e , (5) -e 4 ,P- a.s., (5.8) 

|E[J,(t,x;Q £ ,/3 e )]- ei | <e 4 , j = l,2. (5.9) 

Since (a e , j3 £ ) G At^X-B^T, it follows from Lemma 3.6 that there exists a unique couple (u £ , v e ) G 
Ut,T x Vt,T such that a e {v e ) = u £ ,[3 e (u £ ) = v e . We notice that from Proposition 3.2, (5.6) is 
equivalent to 

P( ^Y*' x ' uS ' vS > W N t,i(j,X$ x ' ue i ve ) - e | Tt) > 1 - e, P - a.s. 

We prove now by contradiction and suppose that (5.6) doesn't hold true. Then, for all e' > 0, 
there exists some e G (0, e') and some stopping time r G [t,T] such that, for some j G {1,2}, 
say for j = 1, 

P(P( l Y^' x ' u£ ' v£ < W N t,i{T,X^ u ^ ve ) - e I T t ) > e) > 0. (5.10) 

Putting 

A = { iYfW'* < W N t,i{T,X^ x ' ue ^) - e } G T T , (5.11) 

and applying Lemma 5.4 to u e and r, we have the existence of an NAD strategy 5 G At,T such 
that, for all v G Vt,Ti 

a{v) = u £ ,on [[f, r]], 
l Y t,x;a(v),v > w t>1 ( T x*' B i 5 W- w ) - F-a.s. (5.12) 
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From Lemma 3.6 we have the existence of a unique couple (u, v) G Ut t T x Vt t such that a(v) = 
u, f3 e (u) = v. From (5.12) we see that u = u £ on [[i,r]], and we put 

u £ , on ([[t,r[[xO)U([[T J T]] x A c ), 
u, on [[r, T]] x A. 

Consequently, from the nonanticipativity of f3 £ G B tt T we see that (3 £ (u) = (3 £ (u £ ) = v e on [[t, r]], 
and for all s G [r, T] , 

\ p e (u°) s = v% onA c . 
Hence, standard arguments for SDEs and BSDEs yield that 

x t,x;uMu) = X t,x;u*,v^ Qn 

x t,x;uA(u) = I X^'^, on [[t,T]} x A, 
' X*'^""'^, on [[r,r]j x A c , 



as well as 

lyt,a:;E!,/3£:(5!) 



Thus, 

_ lg(i,a:;«,/3e(")jl^t,x;5(i'),i)^^ _|_ l-^t,2;« £ ,i> e -j^j 

By virtue of Lemma 2.2 and (5.12) we conclude 

Ji(t ja ;;u,&(5)) > 1 G^ A( " ) [(^M(r,X^ 5 M^)-|)l A + 1 ^i*'.* 8 l Ac ] 

TV* 

Therefore, from (5.11) we deduce that 



1 „t,a:;u,^ e (u) rw , v t,x;u E ,v E \ -, . 1 v t,x;u E ,v E -. £ i 



Putting 



= i G W^[iyM;« e ,^ + £ lA ]. (5.i3) 

2 



let us consider the following BSDE: 



^ = ^> UE ^ + £ -l A + jj N y(r,X^ u£ ^\y r ^ 

r r r r r r ~ 

— A / h r dr — / z r dB r — I h r dN r , sG [t, t], 

Js Js J s 



as well as 



lvt,x\u E ,v E l\rt,x\u E ,v E \ I f \^t,a;;n e ,t) e l\^i,x;n e ,i) e lzjt,x\u E ,v E 1 iyt,x\u E ,v E „,£ „,£\J„ 

r s — r T + ; j N t,i{r, ^v r , J r , -H r , ,u r ,v r )ar 
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-A 



r i H t ^ ue ' ve dr- r x z t r ' x ' ve ' ve dB r - r ^^'^wr, «e %t\. 

*J s *J S " s 



In order to simplify the notations we suppose until the end of this proof that the dimension of 
the Brownian motion d is equal to 1, since we can use a similar arguments for d > 1. Let us set 



Vs = Vs - 'v;'-' : " •'• . h a = h 8 - ; //.I-' : " = z a - l Zl^ £ >v\ s e [t,r]. 

Then we conclude 

e. 



f lr yt,x;u e ,v e l-yt,x;u e ,v £ 1 zrt,x;u £ ,v £ 1 yt,x;u £ ,v £ e „.s\] j 



?' 



-A / h r dr - / z r dB r - / h r dN r , s£[t,r]. (5-14) 
Let us put, for r E [t, r], 

a r = l{y r ^o}(yr)~ 1 (/ A r*' 1 ( r '>^r :r;?te ' ,; " , Vr, h r , Z r , U S r , V*) 

— f (r vt,x;u £ ,v £ lyt,x;u £ ,v £ u ~ „,£ ,,£^1 
J N v > -^r ) r j '•Ti *r> "r) r/ J > 

L i \—lf f t~ vt,x:u £ ,v £ l\rt,x;u £ ,v £ 1 Tit,x\u £ ,v £ „ „,e „,e\ 

»r — -L{2 r ^0}( z rj l/jV^H^^V > *r > H r ,Z r ,U r ,V r ) 

— f (r vt,x;u £ ,v £ l\^t,x;u £ ,v £ 1 Trt,x;u £ ,v £ e „,ey\ 
J N*' \ ' T i r ■> n r i z r , u r , U r ) j . 

Then, from (H5) we deduce that \a r \ < C, \b r \ < C, \c r \ < C, and c r := c r — A > K — X > —1, r S 
[i, r]. Consequently, there exists a constant £o > small enough, such that c r > — l+£o, r E [t, r], 
and BSDE (5.14) can be written as follows: 

y s = — 1_4 + y [a r y r + b r z~ r + c r h r ]dr — J z r dB r — J h r dN r , s € [t,r]. (5.15) 

Let us put 

Mt,T = exp ( / 6 r dS r - i /" |6 r | 2 dr - A / c r dr^j (1 + c r AN r ). 

Jt Jt Jt t<r<r 

Then from the Girsanov theorem we know that there exists a probability measure Q = M$ T ■ P 
defined on (fi, F) such that 

/sAt 
c r dr, s £ [t,T], 

is an (F, Q)-martingale, and 

b r dr, s e [t,T], 



is an (F, Q)-Brownian motion, and both are independent under Q. Therefore, (5.15) takes the 
following form: 



e 



a r y r dr — / ~z r dB r — I h r dN r , s G [t, r]. 

US <J s 
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By applying Ito's formula to we obtain 

y t = £ -E^[l A e^ a ^ dr \F t \ = ^E[l A M t , T eK <* dr \F t \. 
Thanks to the Holder inequality we have 

F(A\F t ) 2 = (E[l A \F t ]) 2 < E[l A M t , T eK '^ dr \F t }E[M£ e~ K ^ \F t ]. 
On the other hand, 

E[M^ +s e-f^ dr \T t ] 

= E[exp ( - jf" a r dr - jf b r dB r + i jf" \b r \ 2 dr + A jf c r dr) JJ (1 + c^iV;,)" 1 ! Jt] 

= E[exp J a rdr - J MA- + ^ jf \b r \ 2 dr + A jf c r (ir) 

x exp ( - y ln(l + <v)diV r ) | 

< exp((l + A)CT)E[exp J b r dB r - i J \b r \ 2 dr^j exp ( - J hx{e Q )dN^j \ F t ] 

< <¥\ 

for some suitably chosen constant Co > 0. Consequently, putting 

A = {p( iy r *^ e < W N t,x{T,Xl> x ' ue > vE )-e \ F t ) > e} ( = {V(A\F t ) > e}), 

we have 

f fC 
y t = -E[l A M t ^^ dr \F t ]>^(E[l A \F t ]) 2 

= £ -^{F{A\F t )) 2 > yC l A . 

Thus, since y t = y t - %^ uE ^ = i G ^> £ [lyM;^ + _ i ^ [ly t, x ^ ^ ^ wg 
obtain 

e 3 

Therefore, (5.13) yields J\(t,x;u, (3 £ (u)) > Ji(i, x; a e , /3 e ) + — CoIa- Let us choose e sufficiently 

e' 3 e 3 
small such that — Co > e' 4 . Then we have — Co > e 4 . Since P(A) > 0, we have a contradiction 

with (5.8) for a(-) = u. The proof is complete. □ 
Proof of Theorem 5.6: Sufficiency of (5.6) and (5.7). 

Proof. We fix arbitrarily e > 0. For eo > being specified later let us assume that (u e °,v £ °) E 
Ut,T x Vt,T satisfies (5.6) and (5.7). In particular, for all s S [t,T] and j = 1,2, 



j Y t,x iu eo, v e > w^^s^x 1 ^ ^ ) - e | F t ) > 1 - e , F - a.s., (5.16) 
lE^^x;?/ ,-^ )] - ej \ <e , (5.17) 
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where we use Proposition 3.2 for the first inequality. 

We fix arbitrarily a partition: t = to < t\ < ••• < t m = T of [t,T], and we put 5 = 
sup \ti — ti + \\. Let us apply Lemma 5.4 to u £o and r = t\, ■ ■ ■ , t m , successively. Then, for E\ > 

i 

(ei depends on e and is specified later) we have the existence of NAD strategies a« G ^4t,T> & = 
1, • • • , m, such that, for all v G V^t, 

aj(u) = u e °,on [t,U], 
2 Y t,x m (v),v < W7vt , 2 (^,xf ;Q!(,,) '") + ei ,P-a. S . (5.18) 

For all u G Vt.T, let us define 

5" = inf |s > t | A({r G [t, a] : v r / < }) > o}, 



t w = inf jti > S v | i = ,m} 



m AT. 



Here we denote by A the Lebesgue measure on the real line K. Then, S v and t v are stopping 
times, and S v < t v < S v + <5. Let us set 



ol f [v 



u £0 , on [t,t v ], 

a.i{v), on \ti, T] x {t v = U}, l<i<m. 



Then a £ is an NAD strategy, and by virtue of (5.18) we obtain 



m 

2 v t,x;a E (v),v ST~^ 2 v t,x;a e (v),v ^ 

r t" - r u l {t v =U} 

i=l 
m 

t,x;Qi;(v),V\ 



= W N t*(f t X%r' ae( > v) > v )+e 1 ,F-a.s. (5.19) 

Let us admit the following lemma for the moment; we shall prove it after. 
Lemma 5.8. For all s > and v G Vt,T, 

J 2 (t,x;a £ (v),v) < J 2 (t,x;u eo ,v eo ) + e, a e (v £0 ) = u eo . 

By a similar argument as that for Lemma 5.8 we can construct f3 E G Bt t T such that, for all 
u G U t ,T, 

Jifrx; «,&(«)) < Ji(t,x;u e »,t; eo )+e, /3 £ (u £ «) = 

From the latter both inequalities, (5.17) and Lemma 5.3 it follows that (a e , (3 e ) satisfies Definition 
5.1. Consequently, (ei,e2) is a Nash equilibrium payoff. □ 

Proof of Lemma 5.8: From (5.19), the Lemmas 2.2 and 2.3 we get the existence of a positive 
constant C such that 



J 2 (t,X,a £ (v),v) = 2 G t^{v),v [2Y t f ^v 



< 2 G^ (w) ^[^(^,Z^ iae( " ) ' ,; )] + C' £l . (5.20) 
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From Proposition 3.9, Lemma 5.5 as well as the definitions of t v and a £ it follows that 



muw^Mt^xtf^ ^ ) - w N t,2(t v ,xlf' a ^ v )\ 2 

Consequently, by virtue of Lemma 2.3 we deduce that 



F t ] <C5, P - a.s. 



2 n t,x\a !: {v),v mr , v v t,x;u e O ,v e 2 r~it,x;a s (v),v rw , +v v t,x;a e (v),v^i 

G t,f» [W N t,2(t ,X tv )\- Lr t)tv [W N t,2{t ,X t v 

< CK[\W N t,2 (t v , X\f ' ,uS ° ' vS ° ) - W N t,2{t\xl 



, v Y t,x;a e {v),v^2 



from which, combined with (5.20), we get 



J 2 (t,x,a £ (v),v) 



2 n t,x;a e {v),v, 
~t,t v [ 

2 n t,x;a s {v),v, 



< 2 G t ^ {vhv [W N ta(t\X t t f' u ^^)] + Ce 1 



x;u £ : v £ . 

t,x;u £ ,v s 2^t,x;a E (v),v r 



+ 1 G t,f» , x v )\- G tr [W N t,2{t ,X tv 



v v t,x;a e (v),v^ 



< 2 Gl$ a * {v) ' v [W Nt ,2(t v } Xt?> ueo ' ve °)] + Cst + C6*. 



For s E [t, T], we put 



n. 



I V' > ^^,2(5, A s ' ' )-eo|- 



Then we have 



J 2 (t,x;a £ (v),v) < 2 Gl^^ v [W Nt ,2(t v ,Xlf' u " ' v " )}+Ce l + CT^ 



< ^^^E^^.^" '^) 1 ^^} 1 "*.] + ^ +^ (5-21) 



where 



i=l 



r — I 2 rit,x\a e (y),v 

1 — I w.t" 



i=l 



i=l 

Noting Lemma 2.3, (5.16) as well as the boundedness of W N t,2 we conclude 

m m 

I < E[El^(^,X*f ;u£0 ^°)| 2 l {t , = , i} lncJ^]5 < C^P^JJ^ < Cmel (5.22) 
i=i ' 1 i=i 

Since 2 Y^ X,U °' v > Wjyt,a(ti, X^' x ' u °' v °) — eo on O^, it follows from Lemma 2.3 that 

m 

m 

2 r it,x;a e {v),v 



i=l 



, 2 r ,t,x;a e (v),urV~^ 2 V '*> :E ;« eo > ,;eo i i i , ^_ 



i=l 
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Similarly to (5.22) we have 

m m 
i=l i=l 

from which together with ^Y^ x ' ae ^ ,v = Yl 2 Yf- X,ae ^' V ^-{t"^} it follows that 

i=l 

m 

i=l 

< 2 Glp as{v) > v l 2 Y^ ue °' v£0 ] + Ce + Cmef 
S I t^t* [ J - i*t,t v i r t v J I 

1 

2 





+ ^r '^ [ ^ x ' uS0 ' v£0 ] + Ce + Cms} 

I 2/^t,x;ae(v),Vr 2 v t,x;u e ,v e 2rit,x\u e , v e r 2 v t,x;u e ,ti e , 

+ J 2 (t, x; n eo , ^ eo ) + Ce + Cme\ . 
Using arguments similar to those in [16] we can show that 



Consequently, 



2 G t, T 4v),v { j2 W Nl ,2{t u xl^ ' veo )l {t , =u} l^] < C& + J 2 (t,x;u £ \v £0 ) + C7e + Cmef- 



't,t v 

i=i 



Thus, from (5.21) and (5.22) we have 

i 

J 2 (t,x;a e (v),v) < J 2 (t,x;u £o ,v £ °) + Ce + Cme§ +Ce l + C5 



We can choose r > 0,£o > 0, and £\ > such that Ceo + Cme§ + Ce\ + C5'2 < e and eo < e. 
Thus, 

J 2 (t,x;a e (v),v) < J 2 (t,x;u £o ,v £ °)+e,v G V t ,r. 

This allows us to complete the proof. □ 

One of our main results of this section is the following existence theorem of a Nash equilibrium 
payoff. 

Theorem 5.9. Under the Isaacs condition, there exists a Nash equilibrium payoff at (t,x), for 
all (t,x) G [0,T] x R n . 

From Theorem 5.6 we only have to prove that, for all e > 0, there exists (u £ , v £ ) G Z^,t x Vt,T 
such that (5.6) and (5.7) hold, for s G [t,T],j = 1,2. The following proposition is crucial for 
this proof and it will be proven after. 

Proposition 5.10. Let the assumptions of Theorem 5.6 hold. Then, for all e > 0, there exists 
(u £ ,v £ ) G Mt,T x Vt,T independent of Ti such that, for all stopping time r (t < r <T) independent 
°f Ft, j = 1,2, (5.6) holds: 

Npy£x;v,;* > W N tj{T,X^ ue ' ve ) - e | T t ) > 1 - e, P- a.s. 
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We now give the proof of Theorem 5.9. 

Proof. For e > 0, let (u £ ,v £ ) G UtT x VtT be obtained by Proposition 5.10. Then (5.6) holds. 
By noticing that (u £ ,v £ ) is independent of Ft we see that Jj(t,x;u £ ,v £ ),j = 1,2, are deter- 
ministic and |(Ji(t, x; u £ , v £ ), J2(t,x;u £ ,v £ )),e > o| is a bounded sequence. Therefore, we can 
choose an accumulation point of this sequence, as e — > 0, and we denote this point by (ei,e2). 
Consequently, from Theorem 5.6 it follows that (ei,e2) is a Nash equilibrium payoff at (t,x). 
The proof is complete. □ 

Before proving Proposition 5.10, let us first make some preliminaries for its proof. 

Lemma 5.11. For all e > 0, 5 G [0, T — t] and x G M n , we have the existence of (u £ ,v £ ) G 
Ut,T x Vt,T independent of Ft, such that, j = 1,2, 



W 3 {t,x)-e< j Gl%Y[W Nt ,(t + 6,X%rn}, P-o-a. 



vt,x;u ,v rjir r± , s- -vt,X\U ,V 

( 

"t+S 

For its proof, we adapt the ideas developed in [16] from SDGs without jumps to SDGs with 
jumps. 

Proof. We denote by F* = p^) s e[t,T] the following filtration: 

F\ := cr^Br -B t ,N r -N t : t < r < s} V Af ¥ , s G [t,T], 

where A/p is the collection of all P-null sets. For s G [t, T], we denote by U\ T (resp., V* T ) the set 
of F*-adapted processes {«r}>e[s,T] (resp., {v r } r e[s,T]) taking their values in U (resp., V), and 
we let A l sT (resp., B l sT ) be the NAD strategies from V* T into U l sT (resp. U l sT into V* T ). 

Let us replace the framework of SDEs driven by a Brownian motion B = (-B s ) s e[o,T] by that 
of SDEs driven by a Brownian motion (B s — Bt) s <=[t,T]i an d let us also replace the framework 
of BSDEs driven by a Brownian motion B = {B s ) s& [ T j and the Poisson process (N s ) sG ^,t] by 
that of B 1 = (B s — Bt) S £\t t T] an d (N s — N t ) s& [t,T]- Using the arguments of Sections 3 and 4 and 
Isaacs condition (4.5), we conclude, for (s,x) G [t,T] x PJ 1 , 

W\(s,x) = esssup essinf J±(s, x; a, f3) = essinf esssup J\(s, x; a, /3), 
W2(s, x) = essinf esssup J2(s, x; a, f3) = esssup essinf J2(s, x; a, (3). 

For j = 1,2, it follows from the Sections 3 and 4 that Wj restricted to [t,T] x W 1 and Wj are 
inside the class of continuous functions with linear growth and the unique viscosity solutions of 
the same system of Isaacs equations. Therefore, 

Wj(s,x) = Wj(s,x), (s,x) G [t,T] x R n ,j = 1,2. 
By virtue of the dynamic programming principle for Wj and V\ t+s C B\ t+s we deduce that 

WAt,x) = Wi(t,x) = esssup essinf l G t ^ P \W K t,i (t + 5, x!'^' )] 

^AU+s^h+s t+S 

< esssup essinf ^^[W N ^ (t + 6, X^f^)]. 
aeAl t+s ^K t+s ' + t+s 

Therefore, for e > and 5 > 0, we have the existence of a £ G A\ t ,g such that, for all v G V* t , 5 , 

W 1 (t,x)-e< ^gf/^'^^^t + ^X^^^)], F-a.s. 
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By a symmetric argument there exists j3 £ £ Bl t +8 such that, for all u £ Uj: t+S , 

W 2 {t,x)-e< a G^ (u >[f^(t + *,A^<% F-a.s. 

In analogy to Lemma 3.6, it can be shown that there exists a unique couple (u £ ,v £ ) £ Utt+5 x 
V t * t+5 such that a £ (v £ ) = u £ ,f3 e (u £ ) = v £ . Consequently, 

Wj (t,x)-e< j Glffi vS iW Nt ,i (t + 6,X%r S ' ve )}, 3 = 1,2. 

t-\-S 

This completes the proof. □ 

Also the following Lemma is crucial for the proof of Proposition 5.10. 

Lemma 5.12. For n > 1, we fix some partition t = to < ti < • • • < t n = T of the interval 
[t,T]. Then, for all e > 0, there exists (u £ ,v £ ) £ Ut,T X Vt,T independent of Ft, such that, for all 
i = 0, • • • , n — 1 and j = 1, 2, 

W„t,i(*i,X t ' )-e< J G t>4 ' [W^ tlJ - )], P-a.s. 

*i 'i+1 

Proof. Let us prove it by induction. Obviously, due to the above lemma, it holds for i = 0. Let 
a couple (u £ ,v £ ) independent of Ft, be constructed on the interval [t,U), and we shall give its 
definition on By virtue of the above lemma we have, for all y £ M n , the existence of 

(u y ,v y ) £ x V*j,T independent of Ft, such that, 

W;fe,I/)-§< ^^[W^J (t l+1 ,X^f^)\, F-a.s,j = l,2. (5.23) 



For j = 1, 2, y, z £ M n and s £ let us set 

vl = j G%l u :' vV [W Nti , (t l+1 ,Xt;ff^)], and y s 2 = [W^ (t i+1> 

'i+1 'i+1 

Then let us consider the following BSDEs: 



t i + l J s 



rU+i fU+i fti+i „ 

A / h r dr — / z\dB r — I h r dN r , s£ 



as well as 

,2 _ w 1+ vU,z;u v ,v v 

"*i+l /"ti + l ft 



H+i J s 



Y? r dr — j z^dB r — I h%dN r , s £ [ij,tj + i]. 

*J S \J S 



From Lemma 2.3 it follows that 

:\U y ,V y 



'i + 1 'i+1 

< CnW 3 (t l+1 ,X^f^) - W nH , (U^X^f^f F U ] 



i+1 

-U,y;u v ,v y \ w /. v U,z;u y ,v y \ i2 

'i + 1 

+CTE[| f N>j {r,X^ uV ' v \yl,hl,zl,uyy r )dr 



23 



Jti 



i+1 



< CE[\X^ VtVV - X^f' vV \ 2 

< C\y-z\ 2 . 



, y r , n r , z r , w r , v r ) ut 
F t ] + CE[ f l+1 \x t r i ' y ' uV ' vV - X, 



Ft, 



ti,z;u v ,v y \2 
r 



dr 



Ft, 



Thus, due to Proposition 3.9 and (5.23) we obtain, for C\y — z\ < — , 

W j {t i ,z)-s < Wj(U,y)-e + C\y-z\ 

< j G^ v [W NH , (t i+1 ,Xti^ v )] - £ - + C\y-z\ 



< J ^Z' ^ ^ X CT ' V )]~ ~+C\y-z\ 

^ j s^lti,Z\U v ,V V r-TjT /, v ti ,z:u y ,V V \n i™ 

< JG u,u +1 [W N ti,j (t i+1 ,X t i'; )], F-a.s. 



z i + l 



We let {Oi}i>i C B(R n ) be a partition of R n with diam(Oi) < — and let yi e O t . Then, for 
-2 G Oj, it follows 



a.s. 



Let us define 



!>1 



Then, we conclude 



t,x;u e ,V r w r, v t,x;u~ ,v~ \i 



t,x\u e ,v £ 



U,X t ' ;u e ,v e v t,x;u s ,v B si 

ti+1 MO,^ )J 



t,x\u ,v 



E w ^(^i.^ 

E '^+1 ^fe+i.** 



)l ,(X|f u )] 



u y l,v y i , 



)]i 0i (x|f 



t,x:u ,v 



1>1 



f i + l 



From (5.24) it follows that 

3 Gum + [ [W N t.j (U +1 ,X t : + [ )] > ^[WWt;,X t : )-e]l ,(X t :' 



1>1 

r , 



from which we conclude the wished result. 



(5.24) 



□ 



Let us come, finally, to the proof of Proposition 5.10. 



Proof. Let j = 1,2 be arbitrarily fixed, and let r be a stopping time independent of Ft, such 
that t < t < T. We put U = + t, A* = < r < ti},i = ,2 n , and define 
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2 n 

r n = ^2 tilAi- It is obvious that < r n — r < 2~ n . From Lemma 5.12 we know that, for all 

i=l 

e > 0, there exists (u £ ,v £ ) £ Ut,T x Vt,T independent of Ft such that, for all stopping time r 
independent of T± , and for alii, (0 < i < 2 n — 1), 

W N t,j{ti,X^' )-£ < J G^' ' [W^tj (i i+ i,X t ' )], P-a.s. 

H H+l 

where £q > depends on e and n, and will be specified after. 

From the Lemmas 2.2 and 2.3 it follows that, for < i < 2 n — 1, 



from where 



'g^'" u> u )] 

t 2 n-l 
t 2 n-l 

> ■ > j ^X 8 f £ [^, (t 4+1 ,X^f^)]-C7(2«-^o 

'i+l 

> ; ^ e ) - C(2 n - i + l)e , 



2'' 
i=l 

2" 2" 

> E U^^,^;^^) ^EU(2 n -i + l)eo 
i=i J i=i 

2" 

> E U^^Xf ^) - C2% = ^(r n ,X^^) - C2%. 
i=i 

Therefore, 

> 'G^f '^[W^(t„,X£^) - C2 n e ] 



it,x:u e ,v £ \tt7- (_ v-t,X',U ,V 

e 



■'(■;■:■;: ' v [w Ntlj (r„, > v ))-i, (5.25) 



2 



for en = — rr- We denote by 
d72 n ~^ 



h = i(t^^[^{X^^)\-W^X^^) + t i (5.26) 
and we put, for s € [r, r n ], 

Obviously, (2/s) s e[T,T„l is the solution of the following BSDE: 



V] = W N t4r n ,X t T ' n x ' u£ ' v£ )+ f Nli 4r,Xl> x ' uS > v \ylX r ,zlu%v s r )dr 
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h],dr — I z].dB r — I hldN r , s£ [r, r n ]. 

o S J S 



We will compare y with the process constant in time y 2 = W N t,j(r, X T ' ' ' ), s € [t, r n ]. We 
observe that y 2 is the solution of a BSDE which driving coefficient equals to zero. Hence, from 
Lemma 2.3 it follows that 

I j /^t,x:u e .v E [11/ /_ \rt,x;u E ,v e \n m /_ \rt.x;u E ,v e \ 1 2 

I W,rk [Wtv^I^, a t ; ' )J - M/^tj (t, A t )| 



+CE[\ I \f„ HJ (r,X t r ^> v ',tf,0,0,->4rfWdr T T \ 



.£ „.£M2. 



< CE[|W^ (r nj X'f " " ) - (r, X? 

where we have used the boundedness of fi, i = 1,2. 

By virtue of the Propositions 3.9 and 6.12 we deduce that 



't,x:u £ ,v E \ 1 2 



-Ft] + C2" 



E[\W Ntj (r n ,X Tn 



t.xtu ,v 



t,x\u £ ,v e \ 1 2n 



^t^IM 6 ,^ 6 \ 1 2n 



< E[|^(r n ,X*f « ) - W Nt Ar n ,X^ 

+E[\W Nt 4r n ,X t T ^ e ) - W^X^^)?] 



r t,x:u £ ,ti e \ 1 2l 



< E[|X*; x;it > e - x*' x;u£ ' t,£ | 2 ] + E[(l + IX^^'^I 2 )^ - T n \] + CE[1 

< C2~ r \ 



(5.27) 



where C > is a constant which depends on x. Therefore, from (5.27) it follows that 
E[| iG%f ^[W^r^X^^)} -W^faX^W')] 2 ] < C2~ n . 

Consequently, E[|Ji — /2I 2 ] < C2~ n . From (5.25) we see that I\ > 0. Therefore, by the above 
inequality we have 



P(/ 2 <-2)<Wi-^|>2)^ 



where we choose n such that 4C2 n < e 3 , i.e., n > (2 + 



e. ^ 4E[|/i -/ 2 | 2 ] ^ 4C2-™ 



< 



lnC-31ne 
hT2 



), and from(5.26) we deduce 



W^(r,^" e ^)-e< ^^'^[^(X^^)]) >l-e, i.e., 



W^Kt.X*' 15 " ) - e < Jy^-*;«".«*)] ) > 1 - e 



Since (u e , w e ) as well as r are independent of Ft, the event jw^tj (r, )— e < iYr' x ' u )| 

is independent of J-"t, from which we see that the conditional probability P(-|J-"t) of 
j W N t, 3 (r, Xr' x ' u '") — £< 3Yt X,u ' v ) j coincides with its probability. Consequently, 



w N tAT,x^ 



t,x:u e ,v e 



e< iy^ u ' v )\ T t )>l-e. 



The proof is complete. 



□ 
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6 Proof of the Theorems 3.10 and 4.2 



6.1 Proof of Theorem 3.10 

We have postponed to this section the proof of the DPP. We shall establish it first for determin- 
istic times, then we deduce the general version for stopping times. 

6.1.1 Dynamic programming principle for deterministic times 

Theorem 6.1. Under the assumptions (HA) and (H5), the following dynamic programming 
principle (DPP) holds: For any < t < t + 6 < T, x G W 1 , i = 1, 2, 

Wi(t,x) = Masupog^^esriT^je^ (6.1) 

U t (t, x) = essinf peBt t+6 esssup aeAt t+s 'G^fp^ (t + 5, X^ a ' p )]. 

Remark 6.2. Recall that for i = l,2,(t,x) G [0, T] x R n , W(t,(x,i)) := Wi(t,x) is the value 
function of the stochastic differential game which dynamics is given by the process (X t ' x > u,v , N t ' 1 ), 
and which cost functional is defined by our BSDE (3.4)- The DPP for games with jumps but of 
the type "strategy against control" was proved in [9], and before, in another framework by Biswas 
[5j. However, unlike [9] we have to deal here with games of the type "NAD strategy against NAD 
strategy ". 

Proof. We only give for arbitrarily fixed i = 1,2, the proof for Wi(t, x), since for Ui(t, x) we can 
use a symmetric argument. Let us denote by W$(t,x) the right hand side of (6.1). Using the 
arguments in Proposition 3.7 we can show that Wg(t, x) is deterministic. We split now the proof 
into the following two lemmas. □ 

Lemma 6.3. Wi(t,x) < W s (t,x). 

Proof. From the definition of Wg(t, x) it follows that 

W s {t,x) = esssup QieAit+5 essinf^ l6Stt+6 ^'^'^[W^^t + 6, Xffi 1 '? 1 )] 
= esssnp ai€Att+s Is(t,x,ai), 

where Ig(t, x, a\) = essinfg l€ g t t G t t ' x f s 1 \W N t,% (t + S, X^fg 011 )]. Then, there exists a se- 

' ' t-\-5 

quence {a*, n > 1} C At,t+8, such that Wg(t,x) = swp n>1 Is(t, x, a*), P-a.s. For any e > 0, let 
us put 

A n := h s (t, x, a l n ) + e > W 5 (t, x), I s (t, x, a]) + e < W s (t, x), 1 < j < n - l} G JF ti n> 1. 

Obviously, {A„, n > 1} is an (O, J r t)-partition. We define a\ := Yl n >i ^^n a n- By a straight- 
forward proof it can be shown that a\ belongs to Att+s- The uniqueness of the FBSDE 
and the definition of NAD strategies allows to show that, for all fi\ G Btt+s-i X t,x ''°' 1, P 1 = 
J2 n >i lh n X t,x ' an >P l . Indeed, let (u n ,v n ) G Ut,T X Vt,T be associated with (a^,/?i) by Lemma 3.6, 
and put 

n>l n>l 

Then straight forward arguments allow to verify that (iif,i>f) G Ut,T x Vt,T is associated with 
(a e ,/3i) by Lemma 3.6 such that a £ (vf) = u\, fi\(u\) = vf. Consequently, 

i <%8*w*<{t+t,^* Jh )] = E ^;;^r"M^(t+^^;T iA )]iA„. (6.2) 

n>l 
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Therefore, for all f3\ G B tj t+s, 

W s (t, x) < ^ lA»JKt, x, a l n ) + e 

n>l 

< E ^ ^S-Tr" 1 ^Nt u (* + *> ^7" A )] + e 

ri>\ 

= i G t ^}^[W N u(t + 5 1 X^f^)]+^ P-a.s. (6.3) 

£ + 

We let {Oj}j>i C £(M n ) be a partition of P n such that J2 °j = Rn and diam(Oj) < e, j > 1. 

j>i ^ 

Let us fix an element yj of Oj, j > 1. Then, from the definition of W k {t + 5,y),k = 1,2, it 
follows (through a procedure already used above) that there exists oP^ G At+s,T such that, for 
all S B t+S>T , 

W k {t + 6, yj) < essm£p 2e]3t+ST J k (t + 5, yj]oP 2 ,k , /3 2 ) + e, P-a.s. 
Therefore, for all /3 2 G B t +s,T, 

2 

W^m (t + 5, yj) = E V^}^'^ + 5 ' fi) 
fc=i 

2 

< E 1 {A r *' 1 =k} J k( t + <*> a 2 /%) + £ 
fc=l t+ 

< J^t.i (t + 5, yj ;a 2 t+s ,f3 2 ) + e, P-a.s. (6.4) 

t-\-S 

For /3 G B t ,r and u 2 G Ut+8,T, we let /3i(tti) := © «2)|[t,t+<s] 5 "1 G Ut,t+6, where «i © u 2 = 
«il[ t t+< 5] + «2l(t+5,T]- Then /3i G B tt t+s- Notice that j3\ doesn't depend on u 2 thanks to the 
nonanticipativity of /3. Since (af,/3i) G At,t+6 x Bt,t+s, we know from Lemma 3.6 that there 
exists a unique pair (u\,vf) G Ut,t+5 x Vt,t+5 such that af(wf) = u\ and /Si(uf) = v\. Let us 
define 

/3f (u 2 ) := fi(u\ © n 2 )|[t+5,T] ) for u 2 G W t+ 5,T, a 2 := E iOi^i+T''^)^' 

Moreover, we put a £ {v) := af(i>i) © af(i>2), for u = «i © f 2 ,fi G Vt,t+a, t> 2 G Vt+^T- Since 
af G At,t+S and a| ^ At+s,T are NAD strategies, a e is also an NAD strategy. 
From Proposition 3.9 it follows that 

V,(* + aS a!,ft )] < ^i 0j (^;T !,/3l )^M.(i + 5,%) + ^e, 

t+o £+0 

which together with (6.3), (6.4) and Lemma 2.2 yields 

W 5 (t,x) < ^f^[W NttU (t + 5,X^ A )]+e, 

< *<^ A lElo i {^ A )W^(t + 8 t y j ) + Ce]+e, P-a.s. 

It follows from (6.4) and the Lemmas 2.2, 2.3 and 3.6 that 

W 5 (t,x) < 'cg^ 1 [J2 lo 3 {X%f 1,Pl )W N u{t + 5, + Ce 
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i>i t+ 
< 'GgjJ^lJ^i (t + tf.-Xj^^jol, A) + Ce] +Ce 

t-\-a 
£ + 

- [ r t+<5 J + ° £ 

= Ji(i,x;a e ,/3) + Ce, P-a.s, for all /9 G B t , T - 

Consequently, due to the choice of a £ we conclude x) < Wi(t, x) + Ce, P-a.s. Letting e i 
we have W s (t, x) < Wi(t, x). □ 

In order to complete the proof of Theorem 6.1 we have to prove the converse inequality. 

Lemma 6.4. Ws(t,x) > Wi(t,x). 

Proof. For an arbitrarily given a G At.T and a given u 2 (") G Vf+<5,T> let us define 

ai(«i) := a(ui © w 2 )|[t,t+5], wi(0 G Vt,t+a, 

where v\ u 2 := i>il[ tjt+( j] + ^lft+^T]- Then ai G At,t+5, and «i does not depend on the choice 
of U2(0 ^ Vt+$T) since a is nonanticipative. Therefore, by virtue of the definition of W$(t, x) we 
know that 

W s (t,x) > essinf ft6Btit+5 ^S^l^^US™ 1 *)]. 

Let us denote by Ig(t, x, a x , /Si) := '^[W^m (i + 5, -^S" 1 )]■ Then there exists a 

sequence n > 1} C B^t+s such that 

I 5 (i,x,ai) := essirri^ ieBM+3 J 5 (t,a;,a<i,/3i) = inf n >i/ 5 (t, x, a x , Pi), P-a.s. 

For any e > 0, n > 1, we let 

A n := x,ai) > x, ai, - e, I 5 (f, x, ai) < I s (t, x, ai, 0]) - e,l < j < n - 1} £ T t . 

Then, {A n } is a partition of (fl, .Ft). We define /3f := X^n>i lA n /?n; and it can be proven that 
/3f G Btj+s- Thanks to the uniqueness of the solution of the FBSDE we have 

I 5 (t,x,ai,(3f) = E l A n h{t,x,ai,Pn), P-a.s. 

n>l 

Indeed, this relation can be proved with an argument analogous to that for (6.2). Therefore, 
W s (t, x) > I s (t,x,ai) > E UJ^^^ai^n) ~ £ = Is(t,x,ax, j3{) - e 

n>l 

' t + o 

Since (ax, f$\ ) G «4t,t+<5 X Bt.t+s, by Lemma 3.6 there exists an unique pair (uf , uf) G Ut,t+5 x Vt,t+<5 
such that ai(vf) = ttf and /3f (uf ) = vf. We also define a|(u2) := a(t>f ® v 2) | [t+<5,T] ? ^2 G Vj+^t- 



29 



For any y G W 1 , k = 1,2, from the definition of W k (t + 5, y) it follows that 

W k (t + 5,y) > essmfp 2&Bt+ST J k (t + 5,y;a e 2, /3 2 ), P-a.s, k = 1,2. 

Using the Lipschitz continuity of W k {t + 5, ■) and J k (t + 5, •) we can prove by approximating 
^t,x,ai, 1 ^ a f^ n i^ e _ va i uec i random variable that 

W k (t + 6, xXr M ) > essird^ eBt+ST J k (t + 6, X^f 1 '^ ; of, ft), P-a.s, fc = 1, 2. 



Therefore, 



(< + 5, X^f 1 '^ ) > essinf A6lw (t + 8, X^f 1 ^; a|,/3 2 ), P-a.s. (6.5) 

£-|-<5 £+<5 

Moreover, there exists some sequence n > 1} C Bt+s,T such that 

essinf^gBj ^J^t.i (t + <5, X*f£ ai ' 1 ; a|, /3 2 ) = inf n >i J„ t>i (i + <5, X*^/* 1 ' 1 ; P-a.s, 

£ + 5 £ + <5 

and we set, for n > 1, 

A n : = \essm.ip 2eB J N t,i (t + 5, X^ff 1 ' 1 ; of, /3 2 ) > J„ M (* + ^X*^/* 1 ' J ; a%, 0^) - e, 

\. ' t-\-S t-\-S 

essmf[3 2€Bt+s T J N t^(t + 5, X*^ 1 ' 1 ; a|, /3 2 ) < J^w^t + 5, xffi 1 ' 1 ; of, /9?) - e, 
1 < j < n - l} G 
Obviously, {A n ,n > 1} is a partition of (O, J^+a). Let us define 

$ := £ ® «2) := /8f(«l) ® /?fM, 



n>l 



for ui G Ut,t+s an d ^2 £ Mt+8,T- Then, from the uniqueness for the equations (3.1) and (3.4), 
combined with Lemma 3.6, it follows that 



Nt+s t+s >« 2 >P 2 ) - t+sy t+s 



^lA„V^ (t + 5,X*;7 lA£ ;a|,^), P-a.s, 



y t+s 
n>l 



which together with (6.5) yields 

W N t,i (f + 5, Xl+f 1 ' 1 ) > essinf^ge T J N t,i (t + 5, X^f 1 ' 1 ;a 2 ,/3 2 

£+5 ' t~\~5 

> £ lA n V,* (£ + 5, X%f lM ; a§, - e 

£+<5 



n>l 



— J N t,i (t + 6, xl+g* u 1 ; a%, /3f) ~ e 

£+5 

- +Y t+5 ~ £ - 

Let a £ (vi ®v 2 ) := a x {vi) ® a e 2 {v 2 ), vi G V M+5 ,w 2 G V t +s,T- Then a e (v)|[ tjt+(5 ] = a(v)|[ f)t+( j], v G 
V t , T . Thus, 

I t+8 ~ I t+S 
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Consequently, by virtue of the Lemmas 2.2 and 2.3 we conclude 

W 5 (t,x) > I 5 (t,x, ai ) > 'Gf^iW^ (t + ^X^P'^-s 

' t -\-5 

^ W.t+d I y t+s -e\-e 
= iY?' x;aS >P e - Ce 

where, for the latter equality, we have used Lemma 3.6. Indeed, letting (uf , uf ) G Ut+s,T x Vt+<s,T 
be associated with (o^,/?!) by Lemma 3.6 we have 

/3 e « ® «I) = /3fK) e ft (u e 2 ) = v{® vl 

a £ {v\ © uf) = a\{v\) © a £ {v{ © v|)| [t+ ^ T] = u? © «|, 

but also a £ (u^ © uf) = a(ff © f|)- Recalling now the arbitrariness of a G ^4j,t we conclude that 
W s (t, x) > Wi(t, x) - Ce. Finally, letting e I we have W 5 (i, x) > x). □ 

From the dynamic programming principle (Theorem 6.1) and standard arguments for BSDEs 
(see Peng [21] or Buckdahn and Li [10]) we obtain the following proposition. 

Proposition 6.5. Under the assumptions {HA) and (H5), W(t,x) is ^ — Holder continuous in 
t, i.e., there exists a positive constant C such that, for all x G W 1 , t,t' G [0,T], 

\Wi(t,x) - Wi(t',x)\ < C(l + \x\)\t - 
6.1.2 Dynamic programming principle for stopping times 

The objective of this subsection is to obtain the dynamic programming principle for stopping 
times. For this end, we need the following proposition, which turns out to be crucial in our 
approach. 

Proposition 6.6. For < t < T , let r be a stopping time such that t < r < T . Then we have 

esssup ai6i4TT essinf^ ie s TT *y^ x ' ai '0 1 = esssup a6AT essinf^ 6fitT z Y^ x ' a ^. 
Proof. We give the proof in two steps. 

Step 1: For all a G At,T and an arbitrary fixed v G Vt,Ti let us define 

a\{v x ) := a(v° © v l )\[ T>T ], v 1 G V T) t, and a (v°) := a(v° © v 1 )]^, v 1 G V t ,t- 

It is straight-forward to check that a\ G A t t- Since a is nonanticipative, ao(v°) only depends 
on v°, but not on v l . We put u° := a>o(v°) and define, for u G Ut,T and /3i G B Tj t /3(u) ■= 
v° © Pi{u l ),u l =u\ [TjT] . Then /3 G B t ,T- 

Since ct\ G A t ,t and (3\ G £> Tj t, by Lemma 3.6, we have the existence of a unique couple 
(u , v ) G U T) t x V r) T such that a\{v l ) = u ,(3i(u ) = v . On the other hand, for a G At : T and 
/3 G £>t,Ti there exists a unique couple (u*,v*) G W^t X Vt,T such that a(t>*) = u*, P(u*) = v*. 
Consequently, 

a^ffiu 1 ) = a (v°) ffiai^ 1 ) =ii ©5 1 , ^(n ©^ 1 ) = t/ ) ©/3 1 (5 1 ) = ^0^. 
From the uniqueness of (u*,v*) it follows that u 1 = f-i* | [ T) t] > ^ = v *I[t,t]- Therefore, 

x T J T r T ± T 
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For q G At,T, 

esssu^^essinf^^^ > essinf^^ > essinf^ T *Y?*°>P '. 

The latter estimate takes into account that we associated with f3\ a particular f3, (3{u) = v° © 
j3\ (u 1 ), u 1 = w|r Tj r], independently of a. Consequently, 

esssup aieAr T essinf^ l6Br T , F T T ' :t ' ai ' ft > esssup QeiAt T essinf y3eB< T 'y^*' ^. 
Step 2: For all e > 0, there exists af € ^4 t ,t such that 

ess S up Qie ^ T essinf ?ieBrT 'r^A < essinf^^ *y^«f.* + e . (6.6) 
For all /3 G and an arbitrary fixed u° G Ut tT , we define, for u 1 G U Ty T and v G V^t, 

^(n 1 ) := /3(u° © n 1 )]^], a £ (u) := u° © af (u 1 ), v 1 = v\ [t>t] . (6.7) 

Then a £ G ^4t,T and /3i G £> Ti x- 

Since a e G .A^t and /3 G Sj 5 Ti by Lemma 3.6 we have the existence of a unique couple 
(u*,v*) G U t ,T x Vt,T such that a e (v*) = u*, f3{u*) = v*. On the other hand, from ct\ G A t ,t and 
/Si G £> Tj ;r it follows that there exists a unique couple (u 1 , v 1 ) G W Tj t X V Tj t such thataf (v 1 ) = 
u , f3\(u l ) = v . Since /3 is nonanticipative, /3(u° ®u )\[t, T ] dependents only on u° and not on S . 
We put (3q(vP) = (3(vP © u 1 )!^ r ],u° G Wt )T . Consequently, /3q G Bt, r , and 

/3( n o e u 1 ) = /3(u° © u% tiT] © ^(S 1 ) = /3 (u°) © ^(S 1 ) = /3 (u°) © v\ 

a e (/3 (u°) © v 1 ) = u° © af (v 1 ) = u° © u 1 . 

Due to the uniqueness of (u*,v*) we obtain v* = /3o(u°) © v , u* = u° © af (v 1 ) = ii° © it 1 . 
Therefore, 

from which combined with (6.6) we get 

esssup aieAriT essinf ?i6B ^ T *Y?' x,ai,Pl < essinf^^ *Y?* ,ai ' 1 + e 
< essinf^ T i 3^T>*> 0|S ^ + e < esssup aeA T essinf^ 6 s t T fy^*-"^ + e . 

For the second estimate we used that /3i in (6.7) is defined with the help of (3 and, thus, runs 
only a subclass of B Ti t- The above both steps allow to conclude the proof. □ 

For a stopping time r with values in [t, T] we define the value functions for a game over the 
stochastic interval [[r, T]] : 

Wi(r,x): = esssuv aeAT/r essmii3 eBrT l Y?> x > a >P, 
Ui(T,x): = essinf^ eBriT esssup Qe _4 TT l YJ' x ' a ^. 

Remark 6.7. Obviously, Wi(t,x) = Wi(t,x),Ui(t,x) = Ui(t,x), for all (t,x) G [0,T] x R n , 
and it can be checked in a straight-forward manner that for all discrete valued stopping times 
t (0 < r <T), i = 1,2, 

Wi(r,x) = Wi(r,x)(:= Wi{t,x)\ t=T ), 
Ui(T,x) = Ui(T,x)(:=Ui(t,x)\ t=T ), F-a.s. 

Our objective is to extend this result to general stopping times. For this end we have to extend 
Proposition 3.9 and Theorem 6.1. 
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Similar to Proposition 3.9 we have from standard BSDEs estimates the following proposition. 

Proposition 6.8. There exists a constant C > such that, for all stopping time r (0 < r < 
T), x,x' G W 1 , i = 1,2, 

\W l (T,x)-W i (T,x')\ <C\X- X '\, \Wi(T,x)\ <C(l + \x\). 

The same property holds for Ui. 

Theorem 6.9. Let the assumptions (H4) and (H5) hold. Then the following dynamic program- 
ming principles hold: For any stopping times r, rj with 0<t<r<r]<T, x G M n , i = 1,2, 

Wi(r,x) = esssup^^essinf^^^iW (6.8) 
Ui{r,x) = esstnf^ v esssup aeAT ^G^lU^ 

Proof. We only comment the proof of the first relation. Let us denote by Wi(r, x) the right hand 
side of 6.8. We prove in a straight-forward way that Wj(r, x) = Wj(r, x). For this we adapt the 
proof of the Lemmas 6.3 and 6.4 in an obvious manner. □ 

From Theorem 6.9 and Proposition 6.8 we can deduce the following proposition. 

Proposition 6.10. Let the assumptions (H4) and (H5) be satisfied. Then, for any stopping 
time T,n with 0<t<T<n<T, x G W 1 , where r\ is supposed to be a (t)— measurable, we have 
the following: 

\W l (T,x)-W i (r ] ,x)\ < C(l + \x\)\t - 7?|5. 

Proof. We only prove that Wi(r,x) — Wi(?],x) < C(l + \x\)t — r/|2, since the other inequality 
can be proved in a similar manner. Let e > 0. In analogy to (6.3), but now for (r, rj) instead of 
(t, t + 6), we can show that there exists some a £ E A T . n such that, for any (3 S B r>TI , 

Consequently, Wj(r, x) — Wi(r), x) < I\ + I2 + h + e, where 

I 3 := 'G^'^i^x^-Wi^x). 

Thanks to Lemma 3.6, we let (u,v) G U T)V x V T)V be such that a £ {v) = u,(3(u) = v, on [[r, rj\]. 

By virtue of Proposition 6.8 there exists some positive constant C which does not depend 
on a £ and (3 such that 

|il| < C(RW^4TI,X^' v )-W^4TI,x)\ 2 \Tr)])$ 

< C(E[|X™ - x| 2 |JV)])l < C(l + |x| 2 )|r - V \K 

where the latter relation follows from standard SDE estimates. Let us denote by ( l Y, l Z, l H) 
the solution of the BSDE: 

-d l Y s = f N t,i{s,X t s ' x ' u,v , l H s , i Z s ,u s ,v s )ds 

-A l H s ds - l Z s dB s - tHsdNs, s G [t, v ], 
% = Wi( V ,x). 
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From the definition of our backward stochastic semigroup and the <r(r)— measurability of r] it 
follows that 

= E[W l (r ] ,x)+ [ f N ^(s,X™, %, Vff a , l Z s ,u s ,v s )ds 



A / l H,ds 



l ZAB« 



l H s dN s 



E[/"/jv^(s,^J w , %, 'H„ l Z s ,u s ,v s )ds-X f n % H s ds 



Therefore, the Schwartz inequality and the Appendix of [9] yield 

< |r-7?|5E[r f|/„t,i( 5) X*™, l Z s ,u s ,v s )\+\\ l H s \YdsF T ] 



< C\t- V \2E[ (\f NT 4 S ,XZ> x -> u ' v ,0,0,0,u s ,v s W + \ l Y s \* + \ *H s \' + \ l Z s \ l )ds 



< C\t-tj\*E[ 1 + |X 



rr,x;u,«|2 + | iy |2 + , ,2 + | i Z \2} ds 



Ft]* 

. _ J Ft]* 

< C(1 + \x\)\t -rj\$. 
Finally, let us give the estimate of 12- From Lemma 2.3 we have 

\h\ < CE[\W N r,i( V ,x) -Wi( V ,x)\\T T ] = CE[\W N r4 V ,x) - W^x^l^^Tr] 

< C(l + |x|)E[l wVi} |J- T ] = C(l + \x\)F[{N^ + i)\T T \ 

< C(l + |x|)(l - exp(-A(? ? - r))) < C(l + |x|)|t - r/|. 

Consequently, from the above inequalities we deduce that 

Wi(T,x) -Wi(ri,x) < C(l + |x|)|r-r/|5 + e , e > 0, 
from where we conclude 

W l (T,x)-W i (r ] ,x) < C(1 + |x|)|t-»/|3. 
The desired result then follows. □ 

Proposition 6.11. Under the assumptions (HA) and (H5), the following holds: Wj(r, x) = 
Wi(r,x), i.e., 

for all stopping time r with values in [t,T]. 

Proof. Let t £ [0, T] be such that t < r < T. Let us define, for i = 1, • • • , 2 n , 



2™ 

+ i, = < r < tjj, and^ = {T = t}, r n = y^Jjl Ai . 



i=0 
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Obviously, < T n — r < — , and from the definition of W{ as well as that of the essential infimun 
and supremun of a family of random variables we deduce 

Wi(r n ,x)(:= Wi(s,x)\ s=Tn ) = esssup a6AT essinf^ eBtT . 

Therefore, Wi{r n ,x) = Wi(r n ,x), F — a.s. Since r < r n < T, and r n is <t(t)— measurable, it 
follows from the Propositions 6.5 and 6.10 that 

\Wi(T,x) -Wi{T n ,x)\ < C(l + \x\)\t - T n fi ->■ 0, as n -)• oo, 

and 

\Wi(T,x) - Wi(r n ,x)\ < C(l + |x|)|r - r n |^ 0, as n -)• oo, 
from where we conclude that also Wi(r, x) = W%{t, x). Therefore, 

Wi(r,x) =esssup aeArT essinf /96BTT l YJ' x ' a ^. 
The proof is complete. □ 

From the above proposition and Proposition 6.10 we immediately have: 

Proposition 6.12. Under the assumptions (H4) and (H5), there is some positive constant C 
such that, for any stopping times t,t] with 0<t<T<rj<T, x G R n , where rj is supposed to 
be a (t)— measurable, we have the following: 

\Wi(T,x) -Wi(r],x)\ < C(1 + \x\)\t-T)\*. 

Theorem 3.10 follows from Proposition 6.11 and Theorem 6.9. We also have the following 
statement, which is a direct consequence of Proposition 6.11. 

Proposition 6.13. Under the assumptions (H4) and (H5), the following holds: 
W N t,i(r,x) = esssup a&AriT essini0 eBTjT N *' V/'*'^. 

6.2 Proof of Theorem 4.2 

Proof. We only give the proof for U = (U±, U2), that for W = (W±, W2) uses a similar argument. 
Let i = 1,2 be arbitrarily fixed, (t,x) G [0,T) x R n , and 5 > 0. We put t 5 = inf{s > t.N? / 
i} A (t + 5). 

For ip G Cf b ([0,T] x M n ), we define 

d 1 

FYs, x, y, h, z, u, v) = —<p(s, x) H — tr(aa T (s, x, u, v)D 2 ip(s, x)) + Dip(s, x)b(s, x, u, v) 
os 2 

+fi(s, x, y + ip(s, x), h + U m{ i +l) (s, x) - ip(s, x), z + Dtp(s, x).a(s, x, u, v),u, v), 

where (s, x, y, h, z, u, v) G [0, T) x R n x R x R x M d x ?7 x 1/. 
Let us consider the following BSDE on the interval [t, r 5 ] : 

l-irl,U,V tti/ v t,X:U,V -trl,U,V TT 1,U,V ryl,U,V \j \ TT 1,U,V j 

-dY s ' = F(s,X s ' ,Y S ' ,H S ' ,Z S ' ,u Sz v s )ds - XH S ' ds 

-Z}' u ' v dB s -H^ v dN s , (6.9) 

Y T Y' v = o, se[t,r% 

where X t ^ u > v is the solution of (3.1) with ( = i£l n 
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We notice that F(s, x, y, h, z, u, v) is Lipschitz in (y, h, z), uniformly in (s, x, u, v), and there 
exists a positive constant C such that 

F(s, x, 0, 0, 0, u, v) < C(l + |x| 2 ), (s, x, u, v) 6 [0,T] xK"x[/x V. 

Consequently, BSDE (6.9) has a unique solution (Y > u,v , H > u,v , Z ,u ' v ). This solution obviously 
depends on 5, but for the sake of simplifying the notations we don't add 5 as superscript to 

^Y\,u,v Jjl,U,V z l,u,v\ 

For the proof of Theorem 4.2, which extends the approaches in [6] and [8] to SDGs with 
jumps, we admit the following lemmas for the moment, they will be proven after. 

Lemma 6.14. For every s G [tjT 5 ]; the following holds: 



sAt s 



Sf\T° ,T a 



Y sAt 5 ' 



where 



In particular, 



Y, 



l,u,v i^jt,x\u,v 



t.T 6 



8 v t,x;u,v\ 



if(t,x). 



(Recall that m(j) = 1, if j is odd, and m(j) = 2, if j is even.) 

We also consider the following BSDE where, in equation (6.9), X t,x ' ,u,v is substituted by its 



deterministic initial value x: 



-Z*' u > v dB s - H^ u ' v dN s , 



(6.10) 



SG [t,T 5 ]. 

Then we have the following comparison between Y 1,u,v and Y 2,u ' v . 
Lemma 6.15. For every 5 G (0, 1) and u G Ut^+S,^ G Vt,t+6, 

\ Y iM-Y*' v ' v \<C67, P-a.s., 

where the constant C does not depend on the control processes u and v, neither on 5 > 0. 
Moreover, we have 

Lemma 6.16. For every u G Utj+SjV G Vt,t+8, we have 

'■t+5 rt+5 r t+S 



E 



rt+o rt+o rt+o 

\Y s 2 ' u ' v \ds\F t ]+E[ \Z^ v \ds\F t ]+E[ \H 2 s ^ v \ds\F t ] < C5 
Jt Jt Jt 



a.s., 



where the constant C is independent oft, 5 as well as of the control processes u, v. 

Let us prove that U = (E/i, E/2) is a viscosity solution of the system (4.1). We begin with showing 
that 

a) U = (C/i , C/2) is a viscosity subsolution of the system (4-1)- 

Let i = 1,2 be arbitrarily fixed, and we suppose that Ui < (p and Ui{t,x) = ip(t,x). We claim 
that 

inf sup F(t, x, 0, 0, 0, u, v) > 0. 
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Observe that, this claim just means that U = {U^U^) satisfies (4.3) of Definition 4.1; we will 
come back to this point. We make the proof by contradiction, and suppose that the above 
claim is not true. Then, thanks to the continuity of F, there exist some 9 > 0, v* £ V and 
< 5' < T - t such that 

supF(s,x,0,0,0,u,u*) < -9 < 0, (6.11) 

ueU 

for all s £ [t, t + 5']. Since Ui < ip and Ui(t, x) = tp(t, x), we have 

cp(T 5 ,Xlf^)l N tj =i + f/ m(i+1) (r 5 ,Xjf' a ' /3 )l 7V i, i=m{i+1) 

> Ui(T S ,X^f ,a,l3 )l N tj =i + C / "m(i+l)(T <5 ,^'r Q ' /3 )l Ar M =m(i+1) 
= U N t,i{T , X' s ,M ). 

From the Lemmas 2.2 and 6.14 it follows that 

> ^^[u Nt 4r 5 ,xl:r^}-^t,x). 

On the other hand, by virtue of Theorem 3.10 we have 

essinfaee^esssup^^ l G l ^ T f' p [U N t,i{T S ,X t ^ a ' p )} - ip(t,x) = Ui{t,x) - <p(t,x) = 0. 



Therefore, essinfgg^ ^esssup^g^ ^Y"/'"'' 3 > 0. Putting (3*{u) = v* on [t,T S ] x U t T s, we have 
/3* G S tr s. From Lemma 6.15 it follows that 

< essinf /3eBt ^esssup Qe ^ tT(S y/' Q ' /3 

< esssup a£AtTg Y t 

< esssup ae ^Y t W * + C'<5l 

-,r2,a(v*),v* , ^tr^- 

= esssup Q6iAt ^y t + C5* 

< esssup ueUtT5 Y t +C5-2. 

Here we have used that Y 2,a '^ = Y 2 ' a ^ v , since f3*(a(v*)) = v*. Furthermore, for all 5 > 
0, e > 0, there exists u E G U t T s such that 

Y?' u '' v > esssup ueUt Tg Y t 2 ' u ' v -e5. 



The two above inequalities yield 



- 1 

Since 



=E [^ T F(s,x,Y?W',Hy ,Z 2 > u£ >v\ul,v* s )ds 
we can deduce from the Lipschitz property of F in (y, h, z) that 



F t 



Y 2,u'y = F ( SfXi Y s 2 ' ue > v *,H 2 ' uE ' v *,Z 2 ' ue > v *,u £ s ,v* s )ds Ft] 
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< E[/ F(s, x,0, 0,0, u £ s ,v*)ds F t ] 



+cm 



\y. 



2,u E ,v*i 



+ \H 



+ \z ; 



2,u e ,v* 



ds 



(6.13) 



We notice that 



E[t + S - r 5 \T t ] < 5K[l t+s>T s\J 7 t] = 5F[t + 5 > r s \F t ] 
= 6(1 - exp(-AJ)) < \5 2 . 

Choosing 5 < 5' we obtain from (6.11) 

r s 

E[ / F(s,x,0,0,0,u £ s ,v* s )ds\F t ] < -6K[t s - t\JF t ] 
< 0(E[t + 5- T 5 \F t ] -$)< 9(X5 2 - 5). 

This together with (6.12), (6.13) and Lemma 6.16 yields — CJa — e5 < X5 2 8 — 65. Therefore, 
— — e < X56 — 6. Letting 5 10, and e | we deduce that 9 < 0, which is in contradiction 
with > 0. Consequently, 

inf sup F(t, x, 0, 0, 0, u, v) > 0. 

Finally, taking into account the definition of F, we see that 
inf sup Fit, x, 0, 0, 0, u, v) 

V ^ V u€U 

f(t,x)+ inf sup i-tr(aa T (t, x, u, v)D 2 ip(t, x)) + D<p(t, x)b(t, x, u, v ) 

+fi(t, x, (p(t, x), U m (i + i) (t, x) - ip(t, x),Dip(t, x)a(t, x, u, v), u, u) j 

d r 1 

= —Lp(t, x) + inf sup \ -tr(aa T (t, x, u, v)D 2 (p(t, x)) + Dip(t, x)b(t, x, u, v) 
at v&v ueU 12 

+fi(t, x, Ui(t, x), U 2 (t, x), D(p(t, x)a(t, x, u, v), u, u)| , 

from where it follows that U = (U\, U2) is a viscosity subsolution of the system (4.1). 

b) Let us show that U = (U\, U2) is also a viscosity supersolution of the system (4-1)- 

Let i = 1,2 be arbitrarily fixed, and we suppose that the test function (p is such that \J% > ip 
and Ui(t,x) = (p(t,x). Then 



0_ 

Of 



8 Y t ' x > a >P\ 

' N z '?=m(i+1) 



TT f~-8 vt,x;a,, 
U N t,i{T , JL g 



and thanks to Lemma 6.14 we have 



1,0,(9 



i n t,x\a,fi\ , 5 v t,x;a,f3\-. 

^ tT s Mr ,X t s H )l N t,i =i + U mi i +1) (T , X t6 )1 



8 v t,x;a,P*. 



^^m^+l)]-^^^) 



< ^ x ^[U Nt 4r\X^ a ' P )}-<P(t,x). 



8 v t,x;a,fi\ 
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Consequently, from Theorem 3.10 

essinfygB^esssupugjv s l G\ x ^ ' [U N t,i{r s , X*f a ' 13 )] - ip(t,x) = 0, 

we obtain that essinfgg^ 4 esssup ag _4 g Y^ ,a ^ < 0. Then, from Lemma 6.15 it follows that 

essinf ( g eBt ^.esssup Qe _ 4i ^y i 2 ' Q,/3 < C6* . 

Hence, there exists f3* E B t T s (depending on 5) such that 

e SS mp aeAtrS Y t 2 ' a 'P* <2C6l (6.14) 

Prom (3* E B tT s it follows that there exists an increasing sequence of stopping times {S n (it)}„>i , 
for all u E U t r s, with t = S (u) < Si (it) < ■ ■ ■ < S n (u) < ■ ■ ■ < t 5 and U„>i{* S '™( u ) = r 5 } = n, 
P-a.s., such that, for all n > 1 and it, v! E lA t T s with it = v! on [[i, S n _i(it)]], it holds 

5,(u) = Si(u'), l<l<n, and f3*(u) = f3*(u'), on [[t,S n (u)}}. 

Therefore, Si as well as v* := /3*(it) on [[t, Si(u)]] do not dependent on the choice of it E U t T s. 
Let us define it* on [[t, Si(u)]] as the process such that u* ASi E U t T s and 

F(s,x, 0,0,0, sup F(s,x,0,0,0,u,i;*), s E [i, Si («*)]. 

Putting i>* := /3*(n* A5l ) on ]]Si(u*), S 2 (u*)]] (Observe that S 2 (it*) only dependents on u* AS ), 
let us define the process it* on [[t, S 2 (u*)]] by u (. A s 2 (u*))\/Si(u*) e ^t,r 5 sucn that 

F(s, x, 0, 0, 0, u*, v*) = sup F(s, x, 0, 0, 0, u, v*), s E [Si (it* ), S 2 (u*)]. 

Therefore, 

F(s,x,0,0,0,<,/3>* A52M ) S ) = supF(a,x,0,0,0 J u J <), s E [t,S 2 (u*)). 

Iterating the above argument we obtain it* on [[t, Soo[[, Sqo := linin^oo f S n (u*) < t s . Choosing 
an arbitrary ito E U, we define it* := u*l[t t s 00 [^' u ohs 00 ,T s ] e ^t,-?- 5 - Since \J n> i{S n (u*) = r 5 } = O 
we can conclude 

F(s,x,0,0,0,u* s ,P*(u* ASn ( u ,)) 8 ) = sup F(s,x, 0,0, 0,tt,v*) 

> inf sup F(s, x, 0, 0, 0, it, v), s E [t, S n (it*)]. 

for all n > 1, and hence, that 

F(s,x,0,0,0,n*,/3*(it*) s ) > inf sup F(s, s, 0, 0, 0, it, «), se[i,T { ]. (6.15) 

V ^U u( zu 

On the other hand, defining ct*(v) = u* on [t,T S ] x ?7 tr «, we deduce from (6.14) 

2CSl > Y t 2 ' a *^ = y?>"*>FW\ (6.16) 
Let us consider the following BSDEs: 



F 2 ^=0, S E[t,r 5 ], 



39 



and 



-dY* = (mf veU suv ueU F(s,x,0,0,(i,u,v) - L\Y*\)ds, , g ^ 

Yi=0, se[t,r s ], 



where we denote by L the Lipschitz constant of F(s, x, y, 0, 0, u, v) with respect to y. Thanks 



to Lemma 2.2 and (6.15) we conclude Y^' u ^ u ' > Y t s . Then from (6.16) and (6.17) it follows 



that 

2C8^ > -Y t s inf sup F{t, x, 0, 0, 0, u, v) 

o v£V u€U 

as 5 — > 0. Therefore, inf„ e y sup ug{/ F(t, x, 0, 0, 0, u, v) < 0. From the definition of F it now 
follows that U = (Ui,U2) is a viscosity supersolution of the system (4.1). We conclude the 
proof. □ 

Let us give the proof of the Lemmas 6.14, 6.15 and 6.16, which is an adaption of those in 
[21] or [9] to our framework of games of the type "NAD strategy against NAD strategy". We 
begin with the 

Proof of Lemma 6.14 We notice that 

i^t,x;u,v r / S v t,x;u,v\-, . TT / S v t,x;u,v\-, l 

(* sAT 6 !T smT ,x tS n N tj =i + u m{i+1) {T ,x t6 n N tj =m{i+1) \ 

is defined by the following BSDE: 

-A *H$ XiU > v d8 - '/l r "- r <lU, - *m x ' u ' v dN s , s G [t,r% (6.18) 

i^}t,x;u,v _ , $ Y t,x;u,V\-, , TT , & Y t,x;u,V\-, 

y T s - <P\T ,A r4 )l N tj =i + U m{i+1) (T ,X rS )l N tJ =rn{i+1 y 

through the following relation: 

G sAtS ^{t ,X tS )l N tj =i + U m{i+1) {T ,X rS )l N tj =m(i+1) \ = Y 8 > , se [t,r j. 

On the other hand, by applying Ito's formula to Y s (see the definition of Y in Lemma 6.14), we 
obtain 

dY s = ^(a, Xl^)ds + (y x <pb)(s, Xl' x ^ v , Us ,v s )ds + (V x <pv)(a, X^ ,u s ,v s )dB s 
+^tr{d xx yoa*){s, X^ u ' v ,u s ,v s )ds + (U m[l+1) (s, X^ v ) - <p( 8 , X^ u ' v ))dN s . (6.19) 
From the definition of we have 

5 v t,x;u,v\ . I fjr f ■yt,x;u,V\ ,„/„ \rt,x:u,v\ 



Y T s = <p(t*,X%>»> v ) + J (U m{i+1) (r,XP^)-<p(r,Xp x ^))dN r 
= ^r a ,X<™) + (tf m(i+1) (r^™) - ^{t\X^ v ))^N tS 

= ^r 5 ,xX' u ' v ) + (twi)(^^ w ) - ip(r 5 ,x^r> v m N ^ =m{l+1) 

= y{T 5 ,X£' u > v )l N t,i =i + U^i+^ir 6 , Xl:s' u ' v )l N tj =mii+1) , 

and thus Y T s = i Y t f' u ' v . Therefore, from the above equality, (6.18) and (6.19), and the unique- 
ness of the solution of BSDE (6.9), it follows that 

v l,u,v i^t^UjV r / 5 v t,x;u,v\-. . TT / X v t,x;u ! v\- l i T7 
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and this allows to conclude the proof. □ 

Proof of Lemma 6.15 Prom (3.2) it follows that, for all p > 2, there exists some positive 



constant C = C p such that 



E[ sup \X$ X '>"' V - x\ p \F t ] < C5(l + \x\ p ), F-a.s., 



t<s<t+S 

uniformly in u G Ut,t+& j v £ Vt,t+5 ■ Let 

r2,U,V Tj2,U,V ry2,U,V 



¥>(*) = F(s,x,Y 2 ^',H 2 ^,Z 2 ^,u s ,v s ) - F(s,Xt^,Y 2 ^,H 2 ^,Z 2 ^,n s ,v s ). 
Then, we have 



\<p(s)\ < C(l + \x\ 2 ){\Xl' x ' u ' v -x\ + \xl m 



■ x 



for s G [t, t + 5], (t, x) G [0, T) x R™, u G ^t,t+<5, v G From Lemma 2.3 it follows that 

pt+S pt+S 
E[ / (l^ 1 '"' 1 ' - if'"' 1 '! 2 + |Z*' U ' W - Z^'f )ds| F t \ + E[ / l-ff^ - fl^fdsl 7i] 

/■t+5 

<CE[^ p 2 (|X*' w -x|)ds|Ji] 



<C5E[ sup p 2 (|^' w 
i<s<t+<5 



<C5 2 , 



where p(r) = (1 + |x| 2 )(r + r 3 ), r > 0. Therefore, we have 
|y t lw - Y 2 ' u ' v \ = \E[(Y?'"' V - Y 2 ' u ' v )\F t ]\ 



-F(s, x, Y 2 ^\ H 2 >^, Z 2 >^,u s ,v s j) ds F t ] \ 



pt+S 

< CE{ J (p(\Xl> x > u > v - x\) + \Y^ V - Y 2 ^ v \ + \Zl' u ' v - Z 2 ' u > v \)ds\F t ] 



pt+S 

+CE[ / \H\w - H 2 ' u > v \ds\F t ] 



< CE[ J t+S p(|X*' w - x\)ds\F t ] + C5^{E[ j t+S \Y s l ' u ' v - Y 2 ' u ' v fds\F t ]^ 

pt+S pt+5 

+E[ J \Zl> u > v - Z 2 s > u > v \ 2 ds\ F t ] 3 + E[ J \H^ V - H 2 ' u > v \ 2 ds\F t ]2} 



The desired result then follows. □ 



Proof of Lemma 6.16: Since F(s, x, u, v) has a linear growth in (y,h,z), uniformly ii 
(s, x, u, v), there exists a positive constant C independent of 5, u and v, such that, for s G [t, t+S] 

pt+S pt+S 

|y2,u,«|2 < CSt E [ / |z r 2 ^| 2 dr|J- s ] < CS, E[ / liJ 2 '"'"! 2 ^!^] < ca. 
By virtue of equation (6.10) we have, for sG [t, £ + <5], 

\Y?> U ' V \ < nf s +& \F(r,x,Y 2 ^,H 2 ^,Z 2 ^,u r ,v r )\dr\F s ] 
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/t+0 
(1 + \x\ 2 + \Y?> U ' V \ + \H?' U ' V \ + \Z 2 ^ v \)dr\F s ] 

< C5 + CV6(E[ f +& \Z?> u ' v \ 2 dr\F s })? + CV6(E[ f** \H?>"> v \ 2 dr\T a ])* 

J s J s 



< CS, P-a.s. 
By applying ltd formula to |l^ 2 ' lt ' ?; | 2 we conclude 

r>t+<5 nt+S 



E 



Therefore, 



[f \Z 2 ' u ' v \ 2 ds\T t ]+K[[ \H 2 s ^ v \ 2 ds\F t ]<C5 2 , P-a.s. 
Jt Jt 



i-t+5 i-t+5 i-t+5 

E[ / \Y?w\da\F t \ + E[ / iZf'^ldal^t] +E[ / ^'"H Ji] 

Ji 

< C5 2 + 5^{E[j' +S \Zl u ' v \ 2 ds\F t }}^ + C5^{E[j' +S \H 2 ' u ' v \ 2 ds\T t }}^ 



<Cjf, P-a.s. 
The proof is complete. □ 
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